Max level shown:
1 [ Jan 17 14:34:03 Enabled. ]
2 [ Jan 17 14:34:03 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 17 14:34:03 Method "start" exited with status 0. ]
4 [ Jan 17 14:34:03 Rereading configuration. ]
5 [ Jan 17 14:34:04 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-17T14:34:04.004ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-17T14:34:04.004ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-17T14:34:04.057ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-17T14:34:04.057ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-17T14:34:04.170ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-17T14:34:04.179ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-17T14:34:04.187ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-17T14:34:04.791ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-17T14:34:04.927ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-17T14:34:04.927ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-17T14:34:04.928ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-17T14:34:04.928ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192025-01-17T14:34:04.928ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202025-01-17T14:34:04.928ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-17T14:34:04.931ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-17T14:34:04.931ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-17T14:34:04.931ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-17T14:34:04.931ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-17T14:34:04.931ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-17T14:34:04.931ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-17T14:34:04.931ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-17T14:34:04.931ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-17T14:34:04.931ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-17T14:34:04.943ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-17T14:34:04.943ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = a2086011-cbfe-46de-a654-f46418d48eec (zpool)
322025-01-17T14:34:05.041ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal }
332025-01-17T14:34:05.392ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-17T14:34:05.392ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-17T14:34:05.392ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-17T14:34:05.392ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-17T14:34:05.392ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-17T14:34:05.392ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-17T14:34:05.392ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-17T14:34:05.400ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-17T14:34:05.400ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool)
422025-01-17T14:34:05.484ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal }
432025-01-17T14:34:05.842ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-17T14:34:05.842ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-17T14:34:05.842ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-17T14:34:05.842ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-17T14:34:05.842ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-17T14:34:05.843ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-17T14:34:05.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-17T14:34:05.843ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-17T14:34:05.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-17T14:34:05.843ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-17T14:34:05.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-17T14:34:05.843ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-17T14:34:05.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-17T14:34:05.843ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-17T14:34:05.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-17T14:34:05.843ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-17T14:34:05.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-17T14:34:05.843ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-17T14:34:05.843ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902025-01-17T14:34:05.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
912025-01-17T14:34:05.843ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
922025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942025-01-17T14:34:05.843ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952025-01-17T14:34:05.843ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962025-01-17T14:34:05.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982025-01-17T14:34:05.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
992025-01-17T14:34:05.843ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002025-01-17T14:34:05.843ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012025-01-17T14:34:05.843ZINFOSledAgent (bootstore): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1022025-01-17T14:34:05.843ZINFOSledAgent (bootstore): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1032025-01-17T14:34:05.843ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1042025-01-17T14:34:05.843ZINFOSledAgent (bootstore): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-17T14:34:05.843ZINFOSledAgent (bootstore): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-17T14:34:05.843ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1072025-01-17T14:34:05.843ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082025-01-17T14:34:05.843ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092025-01-17T14:34:05.854ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1102025-01-17T14:34:05.854ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 11560, tv_nsec: 94599209 } time_to_next_cleanup = 599.999945679s
1112025-01-17T14:34:05.854ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1122025-01-17T14:34:05.854ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1132025-01-17T14:34:05.854ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/sled-agent-request.json file = common/src/ledger.rs:188
1142025-01-17T14:34:05.854ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/sled-agent-request.json file = common/src/ledger.rs:188
1152025-01-17T14:34:05.857ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1162025-01-17T14:34:05.859ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1172025-01-17T14:34:05.859ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1182025-01-17T14:34:05.859ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1192025-01-17T14:34:05.859ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1202025-01-17T14:34:05.859ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1212025-01-17T14:34:05.859ZINFOSledAgent (RSS): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/rss-started.marker file = common/src/ledger.rs:188
1222025-01-17T14:34:05.859ZINFOSledAgent (RSS): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/rss-started.marker file = common/src/ledger.rs:188
1232025-01-17T14:34:05.859ZINFOSledAgent (RSS): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242025-01-17T14:34:05.859ZINFOSledAgent (RSS): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252025-01-17T14:34:05.859ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1262025-01-17T14:34:05.859ZINFOSledAgent (RSS): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1272025-01-17T14:34:05.860ZINFOSledAgent (RSS): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1282025-01-17T14:34:05.860ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1292025-01-17T14:34:05.860ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1302025-01-17T14:34:05.860ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1312025-01-17T14:34:05.860ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1322025-01-17T14:34:05.860ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1332025-01-17T14:34:05.860ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1342025-01-17T14:34:05.860ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1352025-01-17T14:34:05.860ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1362025-01-17T14:34:05.860ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ca190028-ca00-4273-bff2-dd6ceb9e6ccb (sled), rack_id: c10eee8e-2a1a-453f-9423-f97cd0150eaa, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1372025-01-17T14:34:05.861ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1382025-01-17T14:34:05.861ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1392025-01-17T14:34:05.865ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1402025-01-17T14:34:05.871ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1412025-01-17T14:34:05.871ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1422025-01-17T14:34:05.875ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1432025-01-17T14:34:05.876ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1442025-01-17T14:34:05.876ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:40429
1452025-01-17T14:34:05.876ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ca190028-ca00-4273-bff2-dd6ceb9e6ccb (sled), rack_id: c10eee8e-2a1a-453f-9423-f97cd0150eaa, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1462025-01-17T14:34:05.876ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1472025-01-17T14:34:05.876ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1482025-01-17T14:34:05.876ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1492025-01-17T14:34:05.876ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1502025-01-17T14:34:05.876ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1512025-01-17T14:34:05.876ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1522025-01-17T14:34:05.876ZINFOSledAgent (StorageManager): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1532025-01-17T14:34:05.876ZINFOSledAgent (StorageManager): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1542025-01-17T14:34:05.876ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1552025-01-17T14:34:05.876ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1562025-01-17T14:34:05.876ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1572025-01-17T14:34:05.876ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1582025-01-17T14:34:05.876ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1592025-01-17T14:34:05.893ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1602025-01-17T14:34:05.913ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1612025-01-17T14:34:05.929ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1622025-01-17T14:34:05.936ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1632025-01-17T14:34:05.936ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642025-01-17T14:34:05.936ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1652025-01-17T14:34:05.936ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1662025-01-17T14:34:05.939ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 95.619241ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1ebfc19d-2c73-4e74-8e18-1d663e5262b6", "content-length": "124", "date": "Fri, 17 Jan 2025 14:34:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1ebfc19d-2c73-4e74-8e18-1d663e5262b6" } file = clients/ddm-admin-client/src/lib.rs:177
1672025-01-17T14:34:05.949ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_a2086011-cbfe-46de-a654-f46418d48eec/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682025-01-17T14:34:05.971ZINFOSledAgent: successfully created encrypted zvol: name="oxi_a2086011-cbfe-46de-a654-f46418d48eec/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692025-01-17T14:34:05.971ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_a2086011-cbfe-46de-a654-f46418d48eec/swap" file = sled-agent/src/swap_device.rs:96
1702025-01-17T14:34:05.977ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1712025-01-17T14:34:05.977ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1722025-01-17T14:34:05.977ZINFOSledAgent (BackingFs): Ensuring dataset oxi_a2086011-cbfe-46de-a654-f46418d48eec/backing/fmd file = sled-agent/src/backing_fs.rs:139
1732025-01-17T14:34:06.036ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742025-01-17T14:34:06.039ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 89.519811ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "195c32ba-99a7-4852-87e0-e521aad4b82b", "content-length": "124", "date": "Fri, 17 Jan 2025 14:34:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "195c32ba-99a7-4852-87e0-e521aad4b82b" } file = clients/ddm-admin-client/src/lib.rs:177
1752025-01-17T14:34:06.045ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1762025-01-17T14:34:06.130ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-17T14:34:06.131ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 107.129881ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8e4df977-9a45-498d-b765-ffeacb0586bb", "content-length": "124", "date": "Fri, 17 Jan 2025 14:34:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8e4df977-9a45-498d-b765-ffeacb0586bb" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-17T14:34:06.239ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792025-01-17T14:34:06.240ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 151.764911ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4eed7503-9775-45aa-87de-886e65d0a679", "content-length": "124", "date": "Fri, 17 Jan 2025 14:34:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4eed7503-9775-45aa-87de-886e65d0a679" } file = clients/ddm-admin-client/src/lib.rs:177
1802025-01-17T14:34:06.263ZINFOSledAgent (BackingFs): Mounting oxi_a2086011-cbfe-46de-a654-f46418d48eec/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1812025-01-17T14:34:06.276ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1822025-01-17T14:34:06.276ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1832025-01-17T14:34:06.276ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1842025-01-17T14:34:06.276ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1852025-01-17T14:34:06.393ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862025-01-17T14:34:06.394ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 234.616393ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d243f346-db09-4822-863f-0e99f7052a4b", "content-length": "124", "date": "Fri, 17 Jan 2025 14:34:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d243f346-db09-4822-863f-0e99f7052a4b" } file = clients/ddm-admin-client/src/lib.rs:177
1872025-01-17T14:34:06.629ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882025-01-17T14:34:06.630ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 193.487459ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "28aa55c4-394c-4f53-9f47-79b87ef5b93e", "content-length": "124", "date": "Fri, 17 Jan 2025 14:34:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "28aa55c4-394c-4f53-9f47-79b87ef5b93e" } file = clients/ddm-admin-client/src/lib.rs:177
1892025-01-17T14:34:06.824ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902025-01-17T14:34:06.825ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 191.841849ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aeee995b-ff0b-48d6-9aed-806472419ac3", "content-length": "124", "date": "Fri, 17 Jan 2025 14:34:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aeee995b-ff0b-48d6-9aed-806472419ac3" } file = clients/ddm-admin-client/src/lib.rs:177
1912025-01-17T14:34:07.002ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1922025-01-17T14:34:07.007ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:58824 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1932025-01-17T14:34:07.007ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1942025-01-17T14:34:07.007ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:58824 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1952025-01-17T14:34:07.009ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 235.984875ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1962025-01-17T14:34:07.009ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1972025-01-17T14:34:07.009ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
1982025-01-17T14:34:07.009ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
1992025-01-17T14:34:07.009ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2002025-01-17T14:34:07.018ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2012025-01-17T14:34:07.247ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 323.417937ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2022025-01-17T14:34:07.573ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 707.197533ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2032025-01-17T14:34:08.282ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.047110624s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2042025-01-17T14:34:09.679ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2052025-01-17T14:34:09.679ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2062025-01-17T14:34:09.679ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2072025-01-17T14:34:09.679ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2082025-01-17T14:34:09.679ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2092025-01-17T14:34:09.679ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2102025-01-17T14:34:09.681ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2112025-01-17T14:34:09.683ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2122025-01-17T14:34:09.683ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='e69f2fd2-b10d-4e92-b0db-2805e88ca56d'/> <propval type="astring" name="rack_id" value='c10eee8e-2a1a-453f-9423-f97cd0150eaa'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe07:6b01'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='c10eee8e-2a1a-453f-9423-f97cd0150eaa'/> <propval type="astring" name="sled_id" value='ca190028-ca00-4273-bff2-dd6ceb9e6ccb'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='ca190028-ca00-4273-bff2-dd6ceb9e6ccb'/> <propval type="astring" name="rack_uuid" value='c10eee8e-2a1a-453f-9423-f97cd0150eaa'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='ca190028-ca00-4273-bff2-dd6ceb9e6ccb'/> <propval type="astring" name="rack_uuid" value='c10eee8e-2a1a-453f-9423-f97cd0150eaa'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2132025-01-17T14:34:09.683ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2142025-01-17T14:34:10.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 64.112882ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2152025-01-17T14:34:10.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 99.750394ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-01-17T14:34:10.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 190.731186ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-01-17T14:34:10.403ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.763096037s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2182025-01-17T14:34:10.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 277.72241ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-17T14:34:11.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 550.293813ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-01-17T14:34:11.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 696.503739ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-17T14:34:12.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 787.587752ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-17T14:34:13.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 810.757537ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-17T14:34:14.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.135459592s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-17T14:34:16.203ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.092033445s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2252025-01-17T14:34:16.209ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/nexus.rs:527 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2262025-01-17T14:34:16.239ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272025-01-17T14:34:16.240ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2282025-01-17T14:34:16.241ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2292025-01-17T14:34:16.241ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302025-01-17T14:34:16.241ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312025-01-17T14:34:16.241ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-01-17T14:34:16.242ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-17T14:34:16.242ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342025-01-17T14:34:16.242ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352025-01-17T14:34:16.242ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2362025-01-17T14:34:16.242ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:40429
2372025-01-17T14:34:16.430ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2382025-01-17T14:34:16.430ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2392025-01-17T14:34:16.434ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402025-01-17T14:34:16.434ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2412025-01-17T14:34:16.435ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422025-01-17T14:34:16.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41170
2432025-01-17T14:34:16.693ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442025-01-17T14:34:16.693ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-01-17T14:34:16.693ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:188
2462025-01-17T14:34:16.693ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-01-17T14:34:16.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41170 req_id = c74526cc-d8af-47af-9693-f73704d993d1 response_code = 200 uri = /inventory
2482025-01-17T14:34:16.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39258
2492025-01-17T14:34:16.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39258 req_id = 4d524bf6-c828-48d3-82a2-2fd7fc3d9cdc response_code = 200 uri = /sled-role
2502025-01-17T14:34:16.759ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 253a5072-19ee-404b-94cf-1a947255ee9a (physical_disk), pool_id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 256b5b13-7818-4d13-bfea-fccb9af97a7a (physical_disk), pool_id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6875a74f-017a-4197-a406-eae572377597 (physical_disk), pool_id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 87dde1c7-3053-4509-9ae6-30d3dff99ff5 (physical_disk), pool_id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 94f1e19d-c7fb-45a5-9169-30ecbbd91bef (physical_disk), pool_id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 9bb04ebc-ee0a-4e2a-94c2-f4ce52d04397 (physical_disk), pool_id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b46ffc77-c2e1-4053-a0b0-a9f853e2a0e1 (physical_disk), pool_id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: e611135b-e71f-4826-9838-104f653bf79f (physical_disk), pool_id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e7f41afb-7d06-4b6e-9694-0d4fb197ad7e (physical_disk), pool_id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512025-01-17T14:34:16.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49173
2522025-01-17T14:34:16.760ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2532025-01-17T14:34:16.760ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 253a5072-19ee-404b-94cf-1a947255ee9a (physical_disk), pool_id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 256b5b13-7818-4d13-bfea-fccb9af97a7a (physical_disk), pool_id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6875a74f-017a-4197-a406-eae572377597 (physical_disk), pool_id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 87dde1c7-3053-4509-9ae6-30d3dff99ff5 (physical_disk), pool_id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 94f1e19d-c7fb-45a5-9169-30ecbbd91bef (physical_disk), pool_id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 9bb04ebc-ee0a-4e2a-94c2-f4ce52d04397 (physical_disk), pool_id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b46ffc77-c2e1-4053-a0b0-a9f853e2a0e1 (physical_disk), pool_id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: e611135b-e71f-4826-9838-104f653bf79f (physical_disk), pool_id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e7f41afb-7d06-4b6e-9694-0d4fb197ad7e (physical_disk), pool_id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2542025-01-17T14:34:16.760ZINFOSledAgent (StorageManager): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552025-01-17T14:34:16.760ZINFOSledAgent (StorageManager): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562025-01-17T14:34:16.760ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2572025-01-17T14:34:16.760ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582025-01-17T14:34:16.760ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592025-01-17T14:34:16.760ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602025-01-17T14:34:16.760ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612025-01-17T14:34:16.891ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2622025-01-17T14:34:16.891ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool)
2632025-01-17T14:34:17.094ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2642025-01-17T14:34:17.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3810500528879021349 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2652025-01-17T14:34:17.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16527860648900977906 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2662025-01-17T14:34:17.192ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }
2672025-01-17T14:34:17.200ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2682025-01-17T14:34:17.200ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2692025-01-17T14:34:17.200ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2702025-01-17T14:34:17.200ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2712025-01-17T14:34:17.200ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722025-01-17T14:34:17.200ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-01-17T14:34:17.200ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2742025-01-17T14:34:17.234ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752025-01-17T14:34:17.242ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/probe_manager.rs:231 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
2762025-01-17T14:34:17.243ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e/crypt/zone file = sled-storage/src/dataset.rs:302
2772025-01-17T14:34:17.378ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e file = sled-storage/src/dataset.rs:388
2782025-01-17T14:34:17.386ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792025-01-17T14:34:17.386ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802025-01-17T14:34:17.386ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812025-01-17T14:34:17.386ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822025-01-17T14:34:17.386ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832025-01-17T14:34:17.395ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842025-01-17T14:34:17.395ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool)
2852025-01-17T14:34:17.485ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }
2862025-01-17T14:34:17.492ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2872025-01-17T14:34:17.492ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2882025-01-17T14:34:17.492ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2892025-01-17T14:34:17.492ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2902025-01-17T14:34:17.492ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-01-17T14:34:17.492ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-01-17T14:34:17.492ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2932025-01-17T14:34:17.524ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942025-01-17T14:34:17.533ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/zone file = sled-storage/src/dataset.rs:302
2952025-01-17T14:34:17.672ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70 file = sled-storage/src/dataset.rs:388
2962025-01-17T14:34:17.680ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972025-01-17T14:34:17.680ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982025-01-17T14:34:17.680ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992025-01-17T14:34:17.680ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002025-01-17T14:34:17.680ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012025-01-17T14:34:17.689ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022025-01-17T14:34:17.690ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool)
3032025-01-17T14:34:17.782ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }
3042025-01-17T14:34:17.790ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052025-01-17T14:34:17.790ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062025-01-17T14:34:17.790ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072025-01-17T14:34:17.790ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082025-01-17T14:34:17.790ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-01-17T14:34:17.790ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-01-17T14:34:17.790ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112025-01-17T14:34:17.825ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122025-01-17T14:34:17.833ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40/crypt/zone file = sled-storage/src/dataset.rs:302
3132025-01-17T14:34:17.966ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40 file = sled-storage/src/dataset.rs:388
3142025-01-17T14:34:17.974ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152025-01-17T14:34:17.974ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162025-01-17T14:34:17.974ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172025-01-17T14:34:17.974ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182025-01-17T14:34:17.974ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192025-01-17T14:34:17.984ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202025-01-17T14:34:17.984ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool)
3212025-01-17T14:34:18.081ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }
3222025-01-17T14:34:18.088ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3232025-01-17T14:34:18.089ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3242025-01-17T14:34:18.089ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3252025-01-17T14:34:18.089ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3262025-01-17T14:34:18.089ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-01-17T14:34:18.089ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-01-17T14:34:18.089ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3292025-01-17T14:34:18.122ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302025-01-17T14:34:18.130ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/zone file = sled-storage/src/dataset.rs:302
3312025-01-17T14:34:18.247ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/probe_manager.rs:231 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
3322025-01-17T14:34:18.266ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cbe5a810-e05c-4d89-9519-1329dff4d809 file = sled-storage/src/dataset.rs:388
3332025-01-17T14:34:18.274ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342025-01-17T14:34:18.274ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352025-01-17T14:34:18.274ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362025-01-17T14:34:18.274ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372025-01-17T14:34:18.274ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382025-01-17T14:34:18.283ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392025-01-17T14:34:18.283ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool)
3402025-01-17T14:34:18.374ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }
3412025-01-17T14:34:18.381ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422025-01-17T14:34:18.381ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432025-01-17T14:34:18.381ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442025-01-17T14:34:18.381ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452025-01-17T14:34:18.381ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-01-17T14:34:18.381ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-01-17T14:34:18.381ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482025-01-17T14:34:18.414ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492025-01-17T14:34:18.422ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone file = sled-storage/src/dataset.rs:302
3502025-01-17T14:34:18.565ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dfb17780-e3df-4bb3-93ca-7345897ec266 file = sled-storage/src/dataset.rs:388
3512025-01-17T14:34:18.572ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522025-01-17T14:34:18.573ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532025-01-17T14:34:18.573ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542025-01-17T14:34:18.573ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552025-01-17T14:34:18.573ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562025-01-17T14:34:18.583ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572025-01-17T14:34:18.583ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool)
3582025-01-17T14:34:18.675ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }
3592025-01-17T14:34:18.683ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602025-01-17T14:34:18.683ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612025-01-17T14:34:18.683ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622025-01-17T14:34:18.683ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632025-01-17T14:34:18.683ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-01-17T14:34:18.683ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-01-17T14:34:18.683ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662025-01-17T14:34:18.716ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672025-01-17T14:34:18.724ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone file = sled-storage/src/dataset.rs:302
3682025-01-17T14:34:18.868ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5 file = sled-storage/src/dataset.rs:388
3692025-01-17T14:34:18.876ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702025-01-17T14:34:18.876ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712025-01-17T14:34:18.876ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722025-01-17T14:34:18.876ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732025-01-17T14:34:18.876ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742025-01-17T14:34:18.886ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752025-01-17T14:34:18.886ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool)
3762025-01-17T14:34:18.978ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }
3772025-01-17T14:34:18.986ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782025-01-17T14:34:18.986ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792025-01-17T14:34:18.986ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802025-01-17T14:34:18.986ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812025-01-17T14:34:18.986ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-01-17T14:34:18.986ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-01-17T14:34:18.986ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842025-01-17T14:34:19.021ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852025-01-17T14:34:19.029ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone file = sled-storage/src/dataset.rs:302
3862025-01-17T14:34:19.168ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_29b2ad89-d9a3-465b-9769-46ef936e0689 file = sled-storage/src/dataset.rs:388
3872025-01-17T14:34:19.175ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3882025-01-17T14:34:19.175ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3892025-01-17T14:34:19.175ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3902025-01-17T14:34:19.175ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3912025-01-17T14:34:19.175ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3922025-01-17T14:34:19.185ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3932025-01-17T14:34:19.185ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool)
3942025-01-17T14:34:19.288ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }
3952025-01-17T14:34:19.296ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3962025-01-17T14:34:19.296ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3972025-01-17T14:34:19.296ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3982025-01-17T14:34:19.296ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3992025-01-17T14:34:19.296ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002025-01-17T14:34:19.296ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-01-17T14:34:19.296ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4022025-01-17T14:34:19.300ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/probe_manager.rs:231 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4032025-01-17T14:34:19.332ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042025-01-17T14:34:19.340ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9ee40d4b-ea13-4a21-b305-42890e26c365/crypt/zone file = sled-storage/src/dataset.rs:302
4052025-01-17T14:34:19.479ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9ee40d4b-ea13-4a21-b305-42890e26c365 file = sled-storage/src/dataset.rs:388
4062025-01-17T14:34:19.487ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072025-01-17T14:34:19.487ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082025-01-17T14:34:19.487ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092025-01-17T14:34:19.487ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102025-01-17T14:34:19.487ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112025-01-17T14:34:19.497ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122025-01-17T14:34:19.497ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 938658cb-bbce-463a-aa57-19385de71d41 (zpool)
4132025-01-17T14:34:19.598ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }
4142025-01-17T14:34:19.606ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4152025-01-17T14:34:19.606ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4162025-01-17T14:34:19.606ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4172025-01-17T14:34:19.606ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4182025-01-17T14:34:19.606ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-01-17T14:34:19.606ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-01-17T14:34:19.606ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4212025-01-17T14:34:19.644ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222025-01-17T14:34:19.652ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/zone file = sled-storage/src/dataset.rs:302
4232025-01-17T14:34:19.796ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_938658cb-bbce-463a-aa57-19385de71d41 file = sled-storage/src/dataset.rs:388
4242025-01-17T14:34:19.804ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252025-01-17T14:34:19.804ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262025-01-17T14:34:19.804ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272025-01-17T14:34:19.804ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a2086011-cbfe-46de-a654-f46418d48eec (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f586687-d9a7-42a8-a738-8f3a0e5e458f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282025-01-17T14:34:19.804ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292025-01-17T14:34:19.804ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302025-01-17T14:34:19.804ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-17T14:34:19.804ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4322025-01-17T14:34:19.804ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332025-01-17T14:34:19.804ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4342025-01-17T14:34:19.804ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4352025-01-17T14:34:19.805ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4362025-01-17T14:34:19.805ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4372025-01-17T14:34:19.805ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4382025-01-17T14:34:19.805ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392025-01-17T14:34:19.805ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4402025-01-17T14:34:19.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3045030 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49173 req_id = 9944e446-55ea-435e-a119-7cffe9afbc59 response_code = 200 uri = /omicron-physical-disks
4412025-01-17T14:34:19.837ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {017c0889-ea53-4d57-ab2a-56a1bedf8d31 (dataset): DatasetConfig { id: 017c0889-ea53-4d57-ab2a-56a1bedf8d31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a597ef3-e9fd-4e47-9b6e-f8992d14f261 (dataset): DatasetConfig { id: 0a597ef3-e9fd-4e47-9b6e-f8992d14f261 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0acf8c1f-2350-4c86-9937-b79cc9f62853 (dataset): DatasetConfig { id: 0acf8c1f-2350-4c86-9937-b79cc9f62853 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f993200-7332-4a56-a6e6-4bfe0990be4e (dataset): DatasetConfig { id: 0f993200-7332-4a56-a6e6-4bfe0990be4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 188fde1e-94c3-48d3-bf67-749c1a2f77d7 (dataset): DatasetConfig { id: 188fde1e-94c3-48d3-bf67-749c1a2f77d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1947915b-95da-43a0-9b75-3a2c3eea3c3e (dataset): DatasetConfig { id: 1947915b-95da-43a0-9b75-3a2c3eea3c3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 246a2ccf-8663-42c9-bf26-3001945e4d0f (dataset): DatasetConfig { id: 246a2ccf-8663-42c9-bf26-3001945e4d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 276497c2-877d-4fce-a6b6-ebf41ca2f25a (dataset): DatasetConfig { id: 276497c2-877d-4fce-a6b6-ebf41ca2f25a (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2862114d-7cc3-45b0-a4c3-59190ede26dd (dataset): DatasetConfig { id: 2862114d-7cc3-45b0-a4c3-59190ede26dd (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2bee41d7-da8c-4dfe-a57d-ca8fef46f847 (dataset): DatasetConfig { id: 2bee41d7-da8c-4dfe-a57d-ca8fef46f847 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d91e1d6-fc66-4d2d-8c7e-816b5f354d95 (dataset): DatasetConfig { id: 2d91e1d6-fc66-4d2d-8c7e-816b5f354d95 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fcb2a78-2e1a-4c85-a04e-a412ed00d440 (dataset): DatasetConfig { id: 2fcb2a78-2e1a-4c85-a04e-a412ed00d440 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3761c6e4-1326-4c8d-a975-b8e1a7f04ec3 (dataset): DatasetConfig { id: 3761c6e4-1326-4c8d-a975-b8e1a7f04ec3 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a493201-900c-435b-b8dc-7b2dc6ec8119 (dataset): DatasetConfig { id: 3a493201-900c-435b-b8dc-7b2dc6ec8119 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ac7054b-05a4-4efd-8bca-f605d8ab7c5a (dataset): DatasetConfig { id: 3ac7054b-05a4-4efd-8bca-f605d8ab7c5a (dataset), name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fe135b0-c8e4-4f57-a517-4e5f6d143f23 (dataset): DatasetConfig { id: 3fe135b0-c8e4-4f57-a517-4e5f6d143f23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4432e38f-a9a0-4619-b3b8-ca275d5461d1 (dataset): DatasetConfig { id: 4432e38f-a9a0-4619-b3b8-ca275d5461d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46a52be7-d454-40d1-b846-978c01485f95 (dataset): DatasetConfig { id: 46a52be7-d454-40d1-b846-978c01485f95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46fc2cda-1013-4e01-ab2a-74d904216347 (dataset): DatasetConfig { id: 46fc2cda-1013-4e01-ab2a-74d904216347 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4838caab-3cab-4ef0-8c22-f74525ca5222 (dataset): DatasetConfig { id: 4838caab-3cab-4ef0-8c22-f74525ca5222 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48e003a7-1e60-45e7-8f88-c09e2c40f1f6 (dataset): DatasetConfig { id: 48e003a7-1e60-45e7-8f88-c09e2c40f1f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4963f5f2-40d2-49d1-8359-3eee81fd5b82 (dataset): DatasetConfig { id: 4963f5f2-40d2-49d1-8359-3eee81fd5b82 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bcafd49-53f6-4da8-8847-8ef0b78553fd (dataset): DatasetConfig { id: 4bcafd49-53f6-4da8-8847-8ef0b78553fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4be052a0-c4e0-4892-9d3f-68500fd4a4e3 (dataset): DatasetConfig { id: 4be052a0-c4e0-4892-9d3f-68500fd4a4e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d9e0c65-b961-4ee4-a1c9-251b9243035e (dataset): DatasetConfig { id: 4d9e0c65-b961-4ee4-a1c9-251b9243035e (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5792b73d-e40c-40fe-971d-12d8e43aace3 (dataset): DatasetConfig { id: 5792b73d-e40c-40fe-971d-12d8e43aace3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5a781b7d-b9a4-47b0-a23a-3cb57553389a (dataset): DatasetConfig { id: 5a781b7d-b9a4-47b0-a23a-3cb57553389a (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5edf1dc6-63fb-42bf-a997-563542469eb7 (dataset): DatasetConfig { id: 5edf1dc6-63fb-42bf-a997-563542469eb7 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f22196e-e2ca-42ea-a201-147e2eb018f0 (dataset): DatasetConfig { id: 5f22196e-e2ca-42ea-a201-147e2eb018f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a3dc0cd-694f-434f-ad99-d3a329db9fb0 (dataset): DatasetConfig { id: 6a3dc0cd-694f-434f-ad99-d3a329db9fb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70670d61-6a11-44e4-984f-3437b4ac3c05 (dataset): DatasetConfig { id: 70670d61-6a11-44e4-984f-3437b4ac3c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7285b5ce-1402-4a3f-bf39-21cef0c971a2 (dataset): DatasetConfig { id: 7285b5ce-1402-4a3f-bf39-21cef0c971a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77180b65-c86f-470e-a3d0-84cfd3b737cc (dataset): DatasetConfig { id: 77180b65-c86f-470e-a3d0-84cfd3b737cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8360c1f6-1671-4e21-984d-c7cdbeeaaf25 (dataset): DatasetConfig { id: 8360c1f6-1671-4e21-984d-c7cdbeeaaf25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8db6b5a2-9f75-4af6-a572-6e7db9942b07 (dataset): DatasetConfig { id: 8db6b5a2-9f75-4af6-a572-6e7db9942b07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 948bcd4d-62f6-46c3-825d-723fdc75c50d (dataset): DatasetConfig { id: 948bcd4d-62f6-46c3-825d-723fdc75c50d (dataset), name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9507eb1b-8245-41aa-94fe-a50c4b28133a (dataset): DatasetConfig { id: 9507eb1b-8245-41aa-94fe-a50c4b28133a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97a9eab8-2864-4472-a33f-db062c367b8d (dataset): DatasetConfig { id: 97a9eab8-2864-4472-a33f-db062c367b8d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a3e7fab8-f38f-41ba-a14d-74e7d9e19db1 (dataset): DatasetConfig { id: a3e7fab8-f38f-41ba-a14d-74e7d9e19db1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6cb9e9e-cc43-47d9-badb-395d745ea4f3 (dataset): DatasetConfig { id: a6cb9e9e-cc43-47d9-badb-395d745ea4f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a85d44ca-45c1-4192-99c9-f0b4b95bc018 (dataset): DatasetConfig { id: a85d44ca-45c1-4192-99c9-f0b4b95bc018 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a9ed8242-1e2c-4f69-93dc-cc31c0fcfe39 (dataset): DatasetConfig { id: a9ed8242-1e2c-4f69-93dc-cc31c0fcfe39 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aaaa1f08-58c0-4b40-89ed-c9e0c980d21b (dataset): DatasetConfig { id: aaaa1f08-58c0-4b40-89ed-c9e0c980d21b (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aad7f807-3b6c-406c-b1fe-44f7234c1b8d (dataset): DatasetConfig { id: aad7f807-3b6c-406c-b1fe-44f7234c1b8d (dataset), name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ac400c01-ae2f-4c11-81d2-067831d00faa (dataset): DatasetConfig { id: ac400c01-ae2f-4c11-81d2-067831d00faa (dataset), name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ad6dd3f9-044b-432e-a69e-2d0129b30e6a (dataset): DatasetConfig { id: ad6dd3f9-044b-432e-a69e-2d0129b30e6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, af1fbb3e-9d71-4b8b-b122-a7d614e52317 (dataset): DatasetConfig { id: af1fbb3e-9d71-4b8b-b122-a7d614e52317 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aff23bed-5659-41ed-bf3f-ce9f77b9f915 (dataset): DatasetConfig { id: aff23bed-5659-41ed-bf3f-ce9f77b9f915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b177f5d6-06a0-40a6-aedf-5556c324c061 (dataset): DatasetConfig { id: b177f5d6-06a0-40a6-aedf-5556c324c061 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5e3359e-020b-4441-8345-ab48743765bd (dataset): DatasetConfig { id: b5e3359e-020b-4441-8345-ab48743765bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb924a69-57b9-4bfb-a761-b4ad0cddd4d5 (dataset): DatasetConfig { id: bb924a69-57b9-4bfb-a761-b4ad0cddd4d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc355702-11d8-44f3-ac8e-d8fd85d49cd1 (dataset): DatasetConfig { id: bc355702-11d8-44f3-ac8e-d8fd85d49cd1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3f2567b-7a5a-4d95-8d49-f6eda6e0416a (dataset): DatasetConfig { id: c3f2567b-7a5a-4d95-8d49-f6eda6e0416a (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4ece7d8-9395-4b97-a2c5-37806ce48d47 (dataset): DatasetConfig { id: c4ece7d8-9395-4b97-a2c5-37806ce48d47 (dataset), name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ceca0daf-a1c0-43e3-bc4b-fb2033270da7 (dataset): DatasetConfig { id: ceca0daf-a1c0-43e3-bc4b-fb2033270da7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3ec7131-7fd1-4ff5-83ed-e41787b75ff0 (dataset): DatasetConfig { id: d3ec7131-7fd1-4ff5-83ed-e41787b75ff0 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8dd5bc3-6400-4281-8b97-882830ece02b (dataset): DatasetConfig { id: d8dd5bc3-6400-4281-8b97-882830ece02b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db65f2d8-a57c-4d86-9295-244ed6329804 (dataset): DatasetConfig { id: db65f2d8-a57c-4d86-9295-244ed6329804 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df690384-b6fb-4a06-a423-a6e131964966 (dataset): DatasetConfig { id: df690384-b6fb-4a06-a423-a6e131964966 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2be7381-98a2-4cba-b581-0eca6f714e67 (dataset): DatasetConfig { id: e2be7381-98a2-4cba-b581-0eca6f714e67 (dataset), name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e540a935-a2c6-44af-9016-229b5d3bdc34 (dataset): DatasetConfig { id: e540a935-a2c6-44af-9016-229b5d3bdc34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7a23c5a-077a-43a2-af51-12740428e1ad (dataset): DatasetConfig { id: e7a23c5a-077a-43a2-af51-12740428e1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb38e938-0a45-404f-878d-c0c48b5fdd2c (dataset): DatasetConfig { id: eb38e938-0a45-404f-878d-c0c48b5fdd2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f067a3b0-fb3d-4f03-b64d-3d684ee75d21 (dataset): DatasetConfig { id: f067a3b0-fb3d-4f03-b64d-3d684ee75d21 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb1aa936-25ed-4bd6-a242-2956b02a7c57 (dataset): DatasetConfig { id: fb1aa936-25ed-4bd6-a242-2956b02a7c57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffa80dd6-dcef-410b-8f70-6d7bf48ff69f (dataset): DatasetConfig { id: ffa80dd6-dcef-410b-8f70-6d7bf48ff69f (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422025-01-17T14:34:19.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48409
4432025-01-17T14:34:19.837ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4442025-01-17T14:34:19.837ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {017c0889-ea53-4d57-ab2a-56a1bedf8d31 (dataset): DatasetConfig { id: 017c0889-ea53-4d57-ab2a-56a1bedf8d31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a597ef3-e9fd-4e47-9b6e-f8992d14f261 (dataset): DatasetConfig { id: 0a597ef3-e9fd-4e47-9b6e-f8992d14f261 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0acf8c1f-2350-4c86-9937-b79cc9f62853 (dataset): DatasetConfig { id: 0acf8c1f-2350-4c86-9937-b79cc9f62853 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f993200-7332-4a56-a6e6-4bfe0990be4e (dataset): DatasetConfig { id: 0f993200-7332-4a56-a6e6-4bfe0990be4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 188fde1e-94c3-48d3-bf67-749c1a2f77d7 (dataset): DatasetConfig { id: 188fde1e-94c3-48d3-bf67-749c1a2f77d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1947915b-95da-43a0-9b75-3a2c3eea3c3e (dataset): DatasetConfig { id: 1947915b-95da-43a0-9b75-3a2c3eea3c3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 246a2ccf-8663-42c9-bf26-3001945e4d0f (dataset): DatasetConfig { id: 246a2ccf-8663-42c9-bf26-3001945e4d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 276497c2-877d-4fce-a6b6-ebf41ca2f25a (dataset): DatasetConfig { id: 276497c2-877d-4fce-a6b6-ebf41ca2f25a (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2862114d-7cc3-45b0-a4c3-59190ede26dd (dataset): DatasetConfig { id: 2862114d-7cc3-45b0-a4c3-59190ede26dd (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2bee41d7-da8c-4dfe-a57d-ca8fef46f847 (dataset): DatasetConfig { id: 2bee41d7-da8c-4dfe-a57d-ca8fef46f847 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d91e1d6-fc66-4d2d-8c7e-816b5f354d95 (dataset): DatasetConfig { id: 2d91e1d6-fc66-4d2d-8c7e-816b5f354d95 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fcb2a78-2e1a-4c85-a04e-a412ed00d440 (dataset): DatasetConfig { id: 2fcb2a78-2e1a-4c85-a04e-a412ed00d440 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3761c6e4-1326-4c8d-a975-b8e1a7f04ec3 (dataset): DatasetConfig { id: 3761c6e4-1326-4c8d-a975-b8e1a7f04ec3 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a493201-900c-435b-b8dc-7b2dc6ec8119 (dataset): DatasetConfig { id: 3a493201-900c-435b-b8dc-7b2dc6ec8119 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ac7054b-05a4-4efd-8bca-f605d8ab7c5a (dataset): DatasetConfig { id: 3ac7054b-05a4-4efd-8bca-f605d8ab7c5a (dataset), name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fe135b0-c8e4-4f57-a517-4e5f6d143f23 (dataset): DatasetConfig { id: 3fe135b0-c8e4-4f57-a517-4e5f6d143f23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4432e38f-a9a0-4619-b3b8-ca275d5461d1 (dataset): DatasetConfig { id: 4432e38f-a9a0-4619-b3b8-ca275d5461d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46a52be7-d454-40d1-b846-978c01485f95 (dataset): DatasetConfig { id: 46a52be7-d454-40d1-b846-978c01485f95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46fc2cda-1013-4e01-ab2a-74d904216347 (dataset): DatasetConfig { id: 46fc2cda-1013-4e01-ab2a-74d904216347 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4838caab-3cab-4ef0-8c22-f74525ca5222 (dataset): DatasetConfig { id: 4838caab-3cab-4ef0-8c22-f74525ca5222 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48e003a7-1e60-45e7-8f88-c09e2c40f1f6 (dataset): DatasetConfig { id: 48e003a7-1e60-45e7-8f88-c09e2c40f1f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4963f5f2-40d2-49d1-8359-3eee81fd5b82 (dataset): DatasetConfig { id: 4963f5f2-40d2-49d1-8359-3eee81fd5b82 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bcafd49-53f6-4da8-8847-8ef0b78553fd (dataset): DatasetConfig { id: 4bcafd49-53f6-4da8-8847-8ef0b78553fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4be052a0-c4e0-4892-9d3f-68500fd4a4e3 (dataset): DatasetConfig { id: 4be052a0-c4e0-4892-9d3f-68500fd4a4e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d9e0c65-b961-4ee4-a1c9-251b9243035e (dataset): DatasetConfig { id: 4d9e0c65-b961-4ee4-a1c9-251b9243035e (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5792b73d-e40c-40fe-971d-12d8e43aace3 (dataset): DatasetConfig { id: 5792b73d-e40c-40fe-971d-12d8e43aace3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5a781b7d-b9a4-47b0-a23a-3cb57553389a (dataset): DatasetConfig { id: 5a781b7d-b9a4-47b0-a23a-3cb57553389a (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5edf1dc6-63fb-42bf-a997-563542469eb7 (dataset): DatasetConfig { id: 5edf1dc6-63fb-42bf-a997-563542469eb7 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f22196e-e2ca-42ea-a201-147e2eb018f0 (dataset): DatasetConfig { id: 5f22196e-e2ca-42ea-a201-147e2eb018f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a3dc0cd-694f-434f-ad99-d3a329db9fb0 (dataset): DatasetConfig { id: 6a3dc0cd-694f-434f-ad99-d3a329db9fb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70670d61-6a11-44e4-984f-3437b4ac3c05 (dataset): DatasetConfig { id: 70670d61-6a11-44e4-984f-3437b4ac3c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7285b5ce-1402-4a3f-bf39-21cef0c971a2 (dataset): DatasetConfig { id: 7285b5ce-1402-4a3f-bf39-21cef0c971a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77180b65-c86f-470e-a3d0-84cfd3b737cc (dataset): DatasetConfig { id: 77180b65-c86f-470e-a3d0-84cfd3b737cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8360c1f6-1671-4e21-984d-c7cdbeeaaf25 (dataset): DatasetConfig { id: 8360c1f6-1671-4e21-984d-c7cdbeeaaf25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8db6b5a2-9f75-4af6-a572-6e7db9942b07 (dataset): DatasetConfig { id: 8db6b5a2-9f75-4af6-a572-6e7db9942b07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 948bcd4d-62f6-46c3-825d-723fdc75c50d (dataset): DatasetConfig { id: 948bcd4d-62f6-46c3-825d-723fdc75c50d (dataset), name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9507eb1b-8245-41aa-94fe-a50c4b28133a (dataset): DatasetConfig { id: 9507eb1b-8245-41aa-94fe-a50c4b28133a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97a9eab8-2864-4472-a33f-db062c367b8d (dataset): DatasetConfig { id: 97a9eab8-2864-4472-a33f-db062c367b8d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a3e7fab8-f38f-41ba-a14d-74e7d9e19db1 (dataset): DatasetConfig { id: a3e7fab8-f38f-41ba-a14d-74e7d9e19db1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6cb9e9e-cc43-47d9-badb-395d745ea4f3 (dataset): DatasetConfig { id: a6cb9e9e-cc43-47d9-badb-395d745ea4f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a85d44ca-45c1-4192-99c9-f0b4b95bc018 (dataset): DatasetConfig { id: a85d44ca-45c1-4192-99c9-f0b4b95bc018 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a9ed8242-1e2c-4f69-93dc-cc31c0fcfe39 (dataset): DatasetConfig { id: a9ed8242-1e2c-4f69-93dc-cc31c0fcfe39 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aaaa1f08-58c0-4b40-89ed-c9e0c980d21b (dataset): DatasetConfig { id: aaaa1f08-58c0-4b40-89ed-c9e0c980d21b (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aad7f807-3b6c-406c-b1fe-44f7234c1b8d (dataset): DatasetConfig { id: aad7f807-3b6c-406c-b1fe-44f7234c1b8d (dataset), name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ac400c01-ae2f-4c11-81d2-067831d00faa (dataset): DatasetConfig { id: ac400c01-ae2f-4c11-81d2-067831d00faa (dataset), name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ad6dd3f9-044b-432e-a69e-2d0129b30e6a (dataset): DatasetConfig { id: ad6dd3f9-044b-432e-a69e-2d0129b30e6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, af1fbb3e-9d71-4b8b-b122-a7d614e52317 (dataset): DatasetConfig { id: af1fbb3e-9d71-4b8b-b122-a7d614e52317 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aff23bed-5659-41ed-bf3f-ce9f77b9f915 (dataset): DatasetConfig { id: aff23bed-5659-41ed-bf3f-ce9f77b9f915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b177f5d6-06a0-40a6-aedf-5556c324c061 (dataset): DatasetConfig { id: b177f5d6-06a0-40a6-aedf-5556c324c061 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5e3359e-020b-4441-8345-ab48743765bd (dataset): DatasetConfig { id: b5e3359e-020b-4441-8345-ab48743765bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb924a69-57b9-4bfb-a761-b4ad0cddd4d5 (dataset): DatasetConfig { id: bb924a69-57b9-4bfb-a761-b4ad0cddd4d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc355702-11d8-44f3-ac8e-d8fd85d49cd1 (dataset): DatasetConfig { id: bc355702-11d8-44f3-ac8e-d8fd85d49cd1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3f2567b-7a5a-4d95-8d49-f6eda6e0416a (dataset): DatasetConfig { id: c3f2567b-7a5a-4d95-8d49-f6eda6e0416a (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4ece7d8-9395-4b97-a2c5-37806ce48d47 (dataset): DatasetConfig { id: c4ece7d8-9395-4b97-a2c5-37806ce48d47 (dataset), name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ceca0daf-a1c0-43e3-bc4b-fb2033270da7 (dataset): DatasetConfig { id: ceca0daf-a1c0-43e3-bc4b-fb2033270da7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3ec7131-7fd1-4ff5-83ed-e41787b75ff0 (dataset): DatasetConfig { id: d3ec7131-7fd1-4ff5-83ed-e41787b75ff0 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8dd5bc3-6400-4281-8b97-882830ece02b (dataset): DatasetConfig { id: d8dd5bc3-6400-4281-8b97-882830ece02b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db65f2d8-a57c-4d86-9295-244ed6329804 (dataset): DatasetConfig { id: db65f2d8-a57c-4d86-9295-244ed6329804 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df690384-b6fb-4a06-a423-a6e131964966 (dataset): DatasetConfig { id: df690384-b6fb-4a06-a423-a6e131964966 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2be7381-98a2-4cba-b581-0eca6f714e67 (dataset): DatasetConfig { id: e2be7381-98a2-4cba-b581-0eca6f714e67 (dataset), name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e540a935-a2c6-44af-9016-229b5d3bdc34 (dataset): DatasetConfig { id: e540a935-a2c6-44af-9016-229b5d3bdc34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7a23c5a-077a-43a2-af51-12740428e1ad (dataset): DatasetConfig { id: e7a23c5a-077a-43a2-af51-12740428e1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb38e938-0a45-404f-878d-c0c48b5fdd2c (dataset): DatasetConfig { id: eb38e938-0a45-404f-878d-c0c48b5fdd2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f067a3b0-fb3d-4f03-b64d-3d684ee75d21 (dataset): DatasetConfig { id: f067a3b0-fb3d-4f03-b64d-3d684ee75d21 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb1aa936-25ed-4bd6-a242-2956b02a7c57 (dataset): DatasetConfig { id: fb1aa936-25ed-4bd6-a242-2956b02a7c57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffa80dd6-dcef-410b-8f70-6d7bf48ff69f (dataset): DatasetConfig { id: ffa80dd6-dcef-410b-8f70-6d7bf48ff69f (dataset), name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452025-01-17T14:34:19.837ZINFOSledAgent (StorageManager): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-01-17T14:34:19.837ZINFOSledAgent (StorageManager): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-01-17T14:34:19.837ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482025-01-17T14:34:19.853ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492025-01-17T14:34:19.853ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502025-01-17T14:34:19.853ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4512025-01-17T14:34:19.903ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-01-17T14:34:19.903ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-01-17T14:34:19.903ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/zone/oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec"), full_name: "oxp_cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/zone/oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec" } file = sled-storage/src/manager.rs:1431
4542025-01-17T14:34:19.963ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-01-17T14:34:19.963ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4562025-01-17T14:34:19.963ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81" } file = sled-storage/src/manager.rs:1431
4572025-01-17T14:34:20.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-01-17T14:34:20.032ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592025-01-17T14:34:20.032ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3" } file = sled-storage/src/manager.rs:1431
4602025-01-17T14:34:20.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-01-17T14:34:20.094ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4622025-01-17T14:34:20.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone/oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17"), full_name: "oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone/oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17" } file = sled-storage/src/manager.rs:1431
4632025-01-17T14:34:20.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-01-17T14:34:20.156ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652025-01-17T14:34:20.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7" } file = sled-storage/src/manager.rs:1431
4662025-01-17T14:34:20.217ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-01-17T14:34:20.217ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4682025-01-17T14:34:20.217ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/zone"), full_name: "oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/zone" } file = sled-storage/src/manager.rs:1431
4692025-01-17T14:34:20.248ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-01-17T14:34:20.248ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712025-01-17T14:34:20.248ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2" } file = sled-storage/src/manager.rs:1431
4722025-01-17T14:34:20.302ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/probe_manager.rs:231 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
4732025-01-17T14:34:20.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-17T14:34:20.312ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4752025-01-17T14:34:20.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/debug"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/debug" } file = sled-storage/src/manager.rs:1431
4762025-01-17T14:34:20.342ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-17T14:34:20.342ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-17T14:34:20.342ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c" } file = sled-storage/src/manager.rs:1431
4792025-01-17T14:34:20.403ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-17T14:34:20.403ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-01-17T14:34:20.403ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65" } file = sled-storage/src/manager.rs:1431
4822025-01-17T14:34:20.463ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-17T14:34:20.463ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4842025-01-17T14:34:20.463ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/debug"), full_name: "oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/debug" } file = sled-storage/src/manager.rs:1431
4852025-01-17T14:34:20.493ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-01-17T14:34:20.493ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-01-17T14:34:20.493ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4882025-01-17T14:34:20.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-01-17T14:34:20.544ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-01-17T14:34:20.544ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df" } file = sled-storage/src/manager.rs:1431
4912025-01-17T14:34:20.604ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-01-17T14:34:20.604ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932025-01-17T14:34:20.604ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40/crucible" } file = sled-storage/src/manager.rs:1431
4942025-01-17T14:34:20.653ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-01-17T14:34:20.653ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-01-17T14:34:20.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4972025-01-17T14:34:20.703ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-01-17T14:34:20.703ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992025-01-17T14:34:20.703ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb" } file = sled-storage/src/manager.rs:1431
5002025-01-17T14:34:20.765ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-01-17T14:34:20.765ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022025-01-17T14:34:20.765ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e" } file = sled-storage/src/manager.rs:1431
5032025-01-17T14:34:20.826ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-17T14:34:20.826ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-01-17T14:34:20.826ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone/oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5"), full_name: "oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone/oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5" } file = sled-storage/src/manager.rs:1431
5062025-01-17T14:34:20.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-17T14:34:20.885ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-01-17T14:34:20.885ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9" } file = sled-storage/src/manager.rs:1431
5092025-01-17T14:34:20.947ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-17T14:34:20.947ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-01-17T14:34:20.947ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/zone/oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83"), full_name: "oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/zone/oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83" } file = sled-storage/src/manager.rs:1431
5122025-01-17T14:34:21.008ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-01-17T14:34:21.008ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142025-01-17T14:34:21.008ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cbe5a810-e05c-4d89-9519-1329dff4d809/crucible" } file = sled-storage/src/manager.rs:1431
5152025-01-17T14:34:21.055ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-01-17T14:34:21.055ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172025-01-17T14:34:21.055ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crucible" } file = sled-storage/src/manager.rs:1431
5182025-01-17T14:34:21.103ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-01-17T14:34:21.103ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-01-17T14:34:21.103ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5212025-01-17T14:34:21.151ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-01-17T14:34:21.151ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5232025-01-17T14:34:21.151ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/zone/oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0"), full_name: "oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/zone/oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0" } file = sled-storage/src/manager.rs:1431
5242025-01-17T14:34:21.210ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-01-17T14:34:21.210ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5262025-01-17T14:34:21.210ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/debug"), full_name: "oxp_cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/debug" } file = sled-storage/src/manager.rs:1431
5272025-01-17T14:34:21.240ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282025-01-17T14:34:21.240ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292025-01-17T14:34:21.240ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/zone/oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c"), full_name: "oxp_cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/zone/oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c" } file = sled-storage/src/manager.rs:1431
5302025-01-17T14:34:21.302ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312025-01-17T14:34:21.302ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5322025-01-17T14:34:21.302ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5332025-01-17T14:34:21.306ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/probe_manager.rs:231 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
5342025-01-17T14:34:21.354ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-17T14:34:21.354ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5362025-01-17T14:34:21.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone" } file = sled-storage/src/manager.rs:1431
5372025-01-17T14:34:21.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-17T14:34:21.383ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-01-17T14:34:21.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e" } file = sled-storage/src/manager.rs:1431
5402025-01-17T14:34:21.442ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-17T14:34:21.442ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-01-17T14:34:21.442ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone/oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b"), full_name: "oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone/oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b" } file = sled-storage/src/manager.rs:1431
5432025-01-17T14:34:21.503ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-17T14:34:21.503ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-01-17T14:34:21.503ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crucible" } file = sled-storage/src/manager.rs:1431
5462025-01-17T14:34:21.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-01-17T14:34:21.552ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482025-01-17T14:34:21.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5492025-01-17T14:34:21.605ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-01-17T14:34:21.605ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-01-17T14:34:21.605ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be" } file = sled-storage/src/manager.rs:1431
5522025-01-17T14:34:21.666ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-01-17T14:34:21.666ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5542025-01-17T14:34:21.666ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone" } file = sled-storage/src/manager.rs:1431
5552025-01-17T14:34:21.696ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-01-17T14:34:21.697ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5572025-01-17T14:34:21.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a32ead2c-ea11-4639-9370-ffe1738d2f40/crypt/zone"), full_name: "oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40/crypt/zone" } file = sled-storage/src/manager.rs:1431
5582025-01-17T14:34:21.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-01-17T14:34:21.726ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-01-17T14:34:21.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crucible" } file = sled-storage/src/manager.rs:1431
5612025-01-17T14:34:21.775ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-01-17T14:34:21.775ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5632025-01-17T14:34:21.775ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/debug"), full_name: "oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/debug" } file = sled-storage/src/manager.rs:1431
5642025-01-17T14:34:21.804ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-01-17T14:34:21.804ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662025-01-17T14:34:21.804ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/zone/oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6" } file = sled-storage/src/manager.rs:1431
5672025-01-17T14:34:21.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-01-17T14:34:21.864ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692025-01-17T14:34:21.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crucible" } file = sled-storage/src/manager.rs:1431
5702025-01-17T14:34:21.913ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-01-17T14:34:21.913ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5722025-01-17T14:34:21.913ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/debug"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/debug" } file = sled-storage/src/manager.rs:1431
5732025-01-17T14:34:21.942ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-01-17T14:34:21.942ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5752025-01-17T14:34:21.942ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/zone"), full_name: "oxp_cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/zone" } file = sled-storage/src/manager.rs:1431
5762025-01-17T14:34:21.971ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-01-17T14:34:21.971ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5782025-01-17T14:34:21.971ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ee40d4b-ea13-4a21-b305-42890e26c365/crypt/zone"), full_name: "oxp_9ee40d4b-ea13-4a21-b305-42890e26c365/crypt/zone" } file = sled-storage/src/manager.rs:1431
5792025-01-17T14:34:21.999ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-01-17T14:34:21.999ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5812025-01-17T14:34:22.000ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a32ead2c-ea11-4639-9370-ffe1738d2f40/crypt/debug"), full_name: "oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40/crypt/debug" } file = sled-storage/src/manager.rs:1431
5822025-01-17T14:34:22.030ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-01-17T14:34:22.030ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5842025-01-17T14:34:22.030ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/623683ac-fff8-4b77-ac97-9e3fd5ef602e/crypt/debug"), full_name: "oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e/crypt/debug" } file = sled-storage/src/manager.rs:1431
5852025-01-17T14:34:22.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-01-17T14:34:22.059ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5872025-01-17T14:34:22.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ee40d4b-ea13-4a21-b305-42890e26c365/crypt/debug"), full_name: "oxp_9ee40d4b-ea13-4a21-b305-42890e26c365/crypt/debug" } file = sled-storage/src/manager.rs:1431
5882025-01-17T14:34:22.088ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-01-17T14:34:22.088ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5902025-01-17T14:34:22.088ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5912025-01-17T14:34:22.139ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-01-17T14:34:22.139ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932025-01-17T14:34:22.139ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5942025-01-17T14:34:22.192ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952025-01-17T14:34:22.192ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962025-01-17T14:34:22.192ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ee40d4b-ea13-4a21-b305-42890e26c365/crypt/zone/oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c"), full_name: "oxp_9ee40d4b-ea13-4a21-b305-42890e26c365/crypt/zone/oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c" } file = sled-storage/src/manager.rs:1431
5972025-01-17T14:34:22.251ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982025-01-17T14:34:22.251ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992025-01-17T14:34:22.251ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6002025-01-17T14:34:22.301ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012025-01-17T14:34:22.301ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022025-01-17T14:34:22.301ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/623683ac-fff8-4b77-ac97-9e3fd5ef602e/crypt/zone/oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8"), full_name: "oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e/crypt/zone/oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8" } file = sled-storage/src/manager.rs:1431
6032025-01-17T14:34:22.308ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/probe_manager.rs:231 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
6042025-01-17T14:34:22.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-17T14:34:22.361ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-01-17T14:34:22.361ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9ee40d4b-ea13-4a21-b305-42890e26c365/crucible" } file = sled-storage/src/manager.rs:1431
6072025-01-17T14:34:22.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-17T14:34:22.409ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-01-17T14:34:22.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b" } file = sled-storage/src/manager.rs:1431
6102025-01-17T14:34:22.470ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-01-17T14:34:22.470ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-01-17T14:34:22.470ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e/crucible" } file = sled-storage/src/manager.rs:1431
6132025-01-17T14:34:22.518ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-01-17T14:34:22.518ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-01-17T14:34:22.518ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6162025-01-17T14:34:22.568ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-01-17T14:34:22.568ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-01-17T14:34:22.568ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341" } file = sled-storage/src/manager.rs:1431
6192025-01-17T14:34:22.628ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-01-17T14:34:22.628ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212025-01-17T14:34:22.628ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone/oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df"), full_name: "oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone/oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df" } file = sled-storage/src/manager.rs:1431
6222025-01-17T14:34:22.687ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-01-17T14:34:22.687ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6242025-01-17T14:34:22.687ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/zone"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/zone" } file = sled-storage/src/manager.rs:1431
6252025-01-17T14:34:22.718ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-01-17T14:34:22.718ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272025-01-17T14:34:22.718ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/zone/oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67" } file = sled-storage/src/manager.rs:1431
6282025-01-17T14:34:22.779ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-01-17T14:34:22.779ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302025-01-17T14:34:22.779ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a32ead2c-ea11-4639-9370-ffe1738d2f40/crypt/zone/oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc"), full_name: "oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40/crypt/zone/oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc" } file = sled-storage/src/manager.rs:1431
6312025-01-17T14:34:22.838ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-01-17T14:34:22.838ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6332025-01-17T14:34:22.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/623683ac-fff8-4b77-ac97-9e3fd5ef602e/crypt/zone"), full_name: "oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e/crypt/zone" } file = sled-storage/src/manager.rs:1431
6342025-01-17T14:34:22.868ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-17T14:34:22.868ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6362025-01-17T14:34:22.868ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone"), full_name: "oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/zone" } file = sled-storage/src/manager.rs:1431
6372025-01-17T14:34:22.897ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-17T14:34:22.897ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6392025-01-17T14:34:22.897ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/debug"), full_name: "oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/debug" } file = sled-storage/src/manager.rs:1431
6402025-01-17T14:34:22.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-17T14:34:22.926ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-17T14:34:22.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/zone/oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3" } file = sled-storage/src/manager.rs:1431
6432025-01-17T14:34:22.988ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-01-17T14:34:22.988ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-01-17T14:34:22.988ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_938658cb-bbce-463a-aa57-19385de71d41/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6462025-01-17T14:34:23.041ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-01-17T14:34:23.041ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482025-01-17T14:34:23.041ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crucible" } file = sled-storage/src/manager.rs:1431
6492025-01-17T14:34:23.089ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6502025-01-17T14:34:23.089ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-01-17T14:34:23.090ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
6522025-01-17T14:34:23.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3252872 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48409 req_id = d96db534-866e-4a94-82c9-683ff743da39 response_code = 200 uri = /datasets
6532025-01-17T14:34:23.121ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 005036e9-be4e-4ff7-89e2-68e108ae46be (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dbff0acb-5b78-4389-8d1f-3fdacbe97a81 (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ca78ed27-13cf-4207-9a61-681160b3aee9 (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6542025-01-17T14:34:23.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33837
6552025-01-17T14:34:23.122ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6562025-01-17T14:34:23.122ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6572025-01-17T14:34:23.132ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582025-01-17T14:34:23.132ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592025-01-17T14:34:23.141ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-01-17T14:34:23.141ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-01-17T14:34:23.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622025-01-17T14:34:23.150ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:188
6632025-01-17T14:34:23.150ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-01-17T14:34:23.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652025-01-17T14:34:23.196ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-17T14:34:23.196ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-17T14:34:23.196ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-17T14:34:23.247ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81 file = illumos-utils/src/zone.rs:325
6692025-01-17T14:34:23.250ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9 file = illumos-utils/src/zone.rs:325
6702025-01-17T14:34:23.254ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be file = illumos-utils/src/zone.rs:325
6712025-01-17T14:34:23.266ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81 file = illumos-utils/src/zone.rs:363
6722025-01-17T14:34:23.271ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9 file = illumos-utils/src/zone.rs:363
6732025-01-17T14:34:23.275ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be file = illumos-utils/src/zone.rs:363
6742025-01-17T14:34:23.310ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/probe_manager.rs:231 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
6752025-01-17T14:34:24.312ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca190028-ca00-4273-bff2-dd6ceb9e6ccb) file = sled-agent/src/probe_manager.rs:231 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
6762025-01-17T14:34:24.893ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6772025-01-17T14:34:24.893ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6782025-01-17T14:34:24.893ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
6792025-01-17T14:34:25.379ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802025-01-17T14:34:25.859ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6812025-01-17T14:34:25.859ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822025-01-17T14:34:25.859ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6832025-01-17T14:34:25.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 54.569166ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
6842025-01-17T14:34:25.868ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
6852025-01-17T14:34:25.871ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
6862025-01-17T14:34:25.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 134.847584ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
6872025-01-17T14:34:26.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 25.019875ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
6882025-01-17T14:34:26.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 69.326155ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
6892025-01-17T14:34:26.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 62.434399ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
6902025-01-17T14:34:26.171ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6912025-01-17T14:34:26.171ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6922025-01-17T14:34:26.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 101.171327ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
6932025-01-17T14:34:26.258ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6942025-01-17T14:34:26.258ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6952025-01-17T14:34:26.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 264.286608ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
6962025-01-17T14:34:26.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 63.982605ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
6972025-01-17T14:34:26.309ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14529242885525708065 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
6982025-01-17T14:34:26.310ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4019623210516272766 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
6992025-01-17T14:34:26.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 416.380701ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
7002025-01-17T14:34:26.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 120.59748ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7012025-01-17T14:34:26.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 406.010335ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7022025-01-17T14:34:26.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 539.651756ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7032025-01-17T14:34:26.608ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
7042025-01-17T14:34:26.608ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
7052025-01-17T14:34:26.658ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
7062025-01-17T14:34:26.658ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
7072025-01-17T14:34:26.715ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
7082025-01-17T14:34:26.715ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
7092025-01-17T14:34:26.740ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
7102025-01-17T14:34:26.740ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
7112025-01-17T14:34:26.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 475.789363ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
7122025-01-17T14:34:26.817ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7132025-01-17T14:34:26.817ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7142025-01-17T14:34:26.909ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7152025-01-17T14:34:26.909ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7162025-01-17T14:34:26.942ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7172025-01-17T14:34:26.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 648.85734ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7182025-01-17T14:34:26.979ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7192025-01-17T14:34:26.979ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7202025-01-17T14:34:26.980ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7212025-01-17T14:34:26.980ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7222025-01-17T14:34:27.018ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7232025-01-17T14:34:27.071ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7242025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7252025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7272025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7282025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7292025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7312025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7332025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7352025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7372025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7392025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7412025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7432025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7452025-01-17T14:34:27.071ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462025-01-17T14:34:27.097ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3810500528879021349 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
7472025-01-17T14:34:27.098ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16527860648900977906 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
7482025-01-17T14:34:27.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 1.110019448s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7492025-01-17T14:34:27.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 674.077109ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
7502025-01-17T14:34:27.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 939.084141ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7512025-01-17T14:34:27.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 1.327466981s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
7522025-01-17T14:34:28.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 883.368944ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7532025-01-17T14:34:28.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 1.124279103s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7542025-01-17T14:34:29.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 588.914298ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7552025-01-17T14:34:29.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 1.373408338s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
7562025-01-17T14:34:29.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 523.450498ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7572025-01-17T14:34:29.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 1.453419425s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7582025-01-17T14:34:30.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 1.059438242s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7592025-01-17T14:34:30.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 674.838471ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
7602025-01-17T14:34:31.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 1.343011345s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7612025-01-17T14:34:31.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 591.579144ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7622025-01-17T14:34:31.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81") failed: Property not found. retry in 1.046920915s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
7632025-01-17T14:34:31.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9") failed: Property not found. retry in 720.086807ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7642025-01-17T14:34:32.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be") failed: Property not found. retry in 1.248845251s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7652025-01-17T14:34:33.812ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_dbff0acb-5b78-4389-8d1f-3fdacbe97a81
7662025-01-17T14:34:33.812ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_ca78ed27-13cf-4207-9a61-681160b3aee9
7672025-01-17T14:34:33.812ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_005036e9-be4e-4ff7-89e2-68e108ae46be
7682025-01-17T14:34:33.812ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692025-01-17T14:34:33.812ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702025-01-17T14:34:33.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10691402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33837 req_id = ddfbe4a4-7357-478f-83c6-d9deb3d5c6a4 response_code = 204 uri = /omicron-zones
7712025-01-17T14:34:33.815ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-01-17T14:34:33.997ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 86.593913ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7732025-01-17T14:34:34.125ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742025-01-17T14:34:34.201ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752025-01-17T14:34:34.276ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7762025-01-17T14:34:34.276ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7772025-01-17T14:34:34.309ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7782025-01-17T14:34:34.310ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7792025-01-17T14:34:34.310ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7802025-01-17T14:34:34.339ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 005036e9-be4e-4ff7-89e2-68e108ae46be (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dbff0acb-5b78-4389-8d1f-3fdacbe97a81 (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ca78ed27-13cf-4207-9a61-681160b3aee9 (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 (service), filesystem_pool: Some(ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 19dbe943-a2e7-451d-9e2b-93e400a6d6bf, kind: Service { id: 5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 }, name: Name("ntp-5ad3a894-4d4c-4814-97e1-2a43b1fc4d17"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 245])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7812025-01-17T14:34:34.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39776
7822025-01-17T14:34:34.340ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-17T14:34:34.340ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-17T14:34:34.350ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-01-17T14:34:34.350ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-01-17T14:34:34.360ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872025-01-17T14:34:34.360ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882025-01-17T14:34:34.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892025-01-17T14:34:34.370ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:177
7902025-01-17T14:34:34.370ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:177
7912025-01-17T14:34:34.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922025-01-17T14:34:34.382ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7932025-01-17T14:34:34.415ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7942025-01-17T14:34:34.415ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7952025-01-17T14:34:34.415ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7962025-01-17T14:34:34.445ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 182, 245]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7972025-01-17T14:34:34.445ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7982025-01-17T14:34:34.445ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7992025-01-17T14:34:34.445ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
8002025-01-17T14:34:34.446ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8012025-01-17T14:34:34.446ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8022025-01-17T14:34:34.469ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 file = illumos-utils/src/zone.rs:325
8032025-01-17T14:34:34.488ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 file = illumos-utils/src/zone.rs:363
8042025-01-17T14:34:35.099ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8052025-01-17T14:34:35.099ZINFOSledAgent (ServiceManager): Booting oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8062025-01-17T14:34:35.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 51.729958ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8072025-01-17T14:34:35.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 141.403152ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8082025-01-17T14:34:35.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 122.771405ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8092025-01-17T14:34:35.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 289.717383ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8102025-01-17T14:34:35.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 401.222037ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8112025-01-17T14:34:36.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 1.004998394s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8122025-01-17T14:34:36.311ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14529242885525708065 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8132025-01-17T14:34:36.311ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4019623210516272766 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8142025-01-17T14:34:37.099ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3810500528879021349 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8152025-01-17T14:34:37.099ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16527860648900977906 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8162025-01-17T14:34:37.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 756.604902ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8172025-01-17T14:34:38.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 500.435349ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8182025-01-17T14:34:38.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 834.17444ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8192025-01-17T14:34:39.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17") failed: Property not found. retry in 1.4878485s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8202025-01-17T14:34:40.922ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17
8212025-01-17T14:34:40.922ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8222025-01-17T14:34:40.923ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8232025-01-17T14:34:40.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6583481 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39776 req_id = 0cc8948f-c168-42b2-8e07-ddf270203510 response_code = 204 uri = /omicron-zones
8242025-01-17T14:34:40.925ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8252025-01-17T14:34:40.957ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262025-01-17T14:34:40.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65402
8272025-01-17T14:34:40.966ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8282025-01-17T14:34:40.966ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65402 req_id = 0f3089a5-b6f1-4060-9d24-42af39168095 response_code = 500 uri = /timesync
8292025-01-17T14:34:40.969ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8302025-01-17T14:34:41.065ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8312025-01-17T14:34:41.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39459
8322025-01-17T14:34:42.401ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9854575874810112040 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8332025-01-17T14:34:42.658ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18100128858449363322 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8342025-01-17T14:34:43.815ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10848024053820084156 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8352025-01-17T14:34:45.074ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8362025-01-17T14:34:45.074ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008795 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39459 req_id = a7da860f-0748-47fc-824e-7a38bcd3ddc0 response_code = 500 uri = /timesync
8372025-01-17T14:34:45.076ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382025-01-17T14:34:45.281ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8392025-01-17T14:34:45.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63724
8402025-01-17T14:34:45.291ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8412025-01-17T14:34:45.291ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9394 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63724 req_id = 847ad02f-4a6d-4bc4-95bb-2ccfc62ed92b response_code = 500 uri = /timesync
8422025-01-17T14:34:45.293ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8432025-01-17T14:34:45.534ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8442025-01-17T14:34:45.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43930
8452025-01-17T14:34:45.543ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5ad3a894-4d4c-4814-97e1-2a43b1fc4d17': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8462025-01-17T14:34:45.543ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8950 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43930 req_id = f4ead370-164f-441d-86aa-ec5ba7f6c214 response_code = 500 uri = /timesync
8472025-01-17T14:34:45.547ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482025-01-17T14:34:45.740ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-01-17T14:34:45.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58336
8502025-01-17T14:34:46.314ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14529242885525708065 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8512025-01-17T14:34:46.314ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4019623210516272766 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8522025-01-17T14:34:47.101ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3810500528879021349 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8532025-01-17T14:34:47.101ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16527860648900977906 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
8542025-01-17T14:34:49.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4008844 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58336 req_id = c809de15-b612-41db-bf56-89f6864bd9ae response_code = 200 uri = /timesync
8552025-01-17T14:34:49.753ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.014893459 } file = sled-agent/src/rack_setup/service.rs:743
8562025-01-17T14:34:49.753ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8572025-01-17T14:34:49.899ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8582025-01-17T14:34:49.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52282
8592025-01-17T14:34:49.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8925 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52282 req_id = 8656f8e4-8f32-4b95-862b-4fb812677188 response_code = 200 uri = /timesync
8602025-01-17T14:34:49.910ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.014468811 } file = sled-agent/src/rack_setup/service.rs:743
8612025-01-17T14:34:49.910ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8622025-01-17T14:34:50.211ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8632025-01-17T14:34:50.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42284
8642025-01-17T14:34:50.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42284 req_id = 712f124e-ae97-4f21-85f0-230511e8d230 response_code = 200 uri = /timesync
8652025-01-17T14:34:50.237ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1737124489.0470805, correction: 0.013972959 } file = sled-agent/src/rack_setup/service.rs:743
8662025-01-17T14:34:50.237ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8672025-01-17T14:34:50.267ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 005036e9-be4e-4ff7-89e2-68e108ae46be (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dbff0acb-5b78-4389-8d1f-3fdacbe97a81 (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ca78ed27-13cf-4207-9a61-681160b3aee9 (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 (service), filesystem_pool: Some(ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 19dbe943-a2e7-451d-9e2b-93e400a6d6bf, kind: Service { id: 5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 }, name: Name("ntp-5ad3a894-4d4c-4814-97e1-2a43b1fc4d17"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 245])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 24a62d67-c163-4832-95fe-9cdc4fd66b9b (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } } } }, OmicronZoneConfig { id: dd6ab4dc-16ad-4009-8b3a-7156558fc1f3 (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } } } }, OmicronZoneConfig { id: 72a369c3-a429-46bf-ac7c-aeda1693b3b6 (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6d3d9a94-4aa4-48b0-b022-3bae548e9e83 (service), filesystem_pool: Some(ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External } } } }, OmicronZoneConfig { id: 64dde855-ec2d-4160-b218-1425ee65951b (service), filesystem_pool: Some(ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8682025-01-17T14:34:50.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52916
8692025-01-17T14:34:50.268ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8702025-01-17T14:34:50.268ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8712025-01-17T14:34:50.278ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8722025-01-17T14:34:50.278ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8732025-01-17T14:34:50.288ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8742025-01-17T14:34:50.288ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8752025-01-17T14:34:50.298ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8762025-01-17T14:34:50.298ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8772025-01-17T14:34:50.307ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8782025-01-17T14:34:50.307ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8792025-01-17T14:34:50.317ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8802025-01-17T14:34:50.317ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8812025-01-17T14:34:50.326ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8822025-01-17T14:34:50.326ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8832025-01-17T14:34:50.335ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8842025-01-17T14:34:50.335ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8852025-01-17T14:34:50.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8862025-01-17T14:34:50.344ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:177
8872025-01-17T14:34:50.344ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:177
8882025-01-17T14:34:50.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8892025-01-17T14:34:50.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8902025-01-17T14:34:50.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8912025-01-17T14:34:50.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8922025-01-17T14:34:50.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8932025-01-17T14:34:50.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8942025-01-17T14:34:50.520ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6 file = illumos-utils/src/zone.rs:325
8952025-01-17T14:34:50.524ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83 file = illumos-utils/src/zone.rs:325
8962025-01-17T14:34:50.528ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b file = illumos-utils/src/zone.rs:325
8972025-01-17T14:34:50.532ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b file = illumos-utils/src/zone.rs:325
8982025-01-17T14:34:50.536ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3 file = illumos-utils/src/zone.rs:325
8992025-01-17T14:34:50.541ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6 file = illumos-utils/src/zone.rs:363
9002025-01-17T14:34:50.546ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83 file = illumos-utils/src/zone.rs:363
9012025-01-17T14:34:50.551ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b file = illumos-utils/src/zone.rs:363
9022025-01-17T14:34:50.556ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b file = illumos-utils/src/zone.rs:363
9032025-01-17T14:34:50.560ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3 file = illumos-utils/src/zone.rs:363
9042025-01-17T14:34:51.360ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 242.125973ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
9052025-01-17T14:34:53.546ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='72a369c3-a429-46bf-ac7c-aeda1693b3b6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9062025-01-17T14:34:53.546ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9072025-01-17T14:34:53.626ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='dd6ab4dc-16ad-4009-8b3a-7156558fc1f3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9082025-01-17T14:34:53.626ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9092025-01-17T14:34:53.654ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6d3d9a94-4aa4-48b0-b022-3bae548e9e83'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9102025-01-17T14:34:53.655ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='24a62d67-c163-4832-95fe-9cdc4fd66b9b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9112025-01-17T14:34:53.655ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9122025-01-17T14:34:53.660ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9132025-01-17T14:34:53.665ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='64dde855-ec2d-4160-b218-1425ee65951b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9142025-01-17T14:34:53.665ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9152025-01-17T14:34:53.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 44.761782ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9162025-01-17T14:34:53.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 96.460519ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9172025-01-17T14:34:53.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 37.022404ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9182025-01-17T14:34:53.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 50.147814ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9192025-01-17T14:34:53.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 58.306625ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9202025-01-17T14:34:53.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 59.425858ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9212025-01-17T14:34:54.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 163.784594ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9222025-01-17T14:34:54.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 138.842156ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9232025-01-17T14:34:54.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 105.700222ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9242025-01-17T14:34:54.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 51.919087ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9252025-01-17T14:34:54.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 117.465146ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9262025-01-17T14:34:54.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 364.279733ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9272025-01-17T14:34:55.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 148.47626ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9282025-01-17T14:34:55.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 267.596749ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9292025-01-17T14:34:55.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 64.536255ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9302025-01-17T14:34:55.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 454.585803ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9312025-01-17T14:34:55.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 158.973808ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9322025-01-17T14:34:55.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 442.77144ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9332025-01-17T14:34:55.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 301.704561ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9342025-01-17T14:34:55.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 265.721165ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9352025-01-17T14:34:55.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 430.364071ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9362025-01-17T14:34:55.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 457.396864ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9372025-01-17T14:34:55.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 528.236061ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9382025-01-17T14:34:55.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 1.026845008s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9392025-01-17T14:34:55.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 848.552135ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9402025-01-17T14:34:55.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 781.035742ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9412025-01-17T14:34:56.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 770.043452ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9422025-01-17T14:34:56.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.025188819s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9432025-01-17T14:34:56.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 569.35494ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9442025-01-17T14:34:56.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 621.272413ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9452025-01-17T14:34:56.637ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53604
9462025-01-17T14:34:56.638ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53604 req_id = e6369bd5-2a30-43cb-b15b-8cb73049a670 response_code = 200 uri = /baseboard
9472025-01-17T14:34:56.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 611.654471ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9482025-01-17T14:34:56.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 928.267801ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9492025-01-17T14:34:57.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 639.458573ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9502025-01-17T14:34:57.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.04279515s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9512025-01-17T14:34:57.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 1.270442489s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9522025-01-17T14:34:57.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 1.258828557s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9532025-01-17T14:34:57.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 1.365654507s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9542025-01-17T14:34:57.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 791.912493ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9552025-01-17T14:34:58.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 996.86674ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9562025-01-17T14:34:58.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 630.031587ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9572025-01-17T14:34:58.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 1.410835665s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9582025-01-17T14:34:58.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 1.139021651s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9592025-01-17T14:34:59.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 931.50994ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9602025-01-17T14:34:59.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 898.342827ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9612025-01-17T14:34:59.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.237009284s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9622025-01-17T14:34:59.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 684.890757ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9632025-01-17T14:34:59.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 633.717887ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9642025-01-17T14:35:00.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 1.205545883s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9652025-01-17T14:35:00.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 1.457285882s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9662025-01-17T14:35:00.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 687.176275ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9672025-01-17T14:35:00.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.441846998s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9682025-01-17T14:35:00.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 876.849973ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9692025-01-17T14:35:01.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 640.868344ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9702025-01-17T14:35:01.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 1.006923576s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9712025-01-17T14:35:01.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 679.402578ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9722025-01-17T14:35:01.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 721.889318ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9732025-01-17T14:35:01.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3") failed: Property not found. retry in 1.07656192s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
9742025-01-17T14:35:01.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.452796033s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9752025-01-17T14:35:02.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 954.94946ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9762025-01-17T14:35:02.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6") failed: Property not found. retry in 1.023474317s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
9772025-01-17T14:35:02.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83") failed: Property not found. retry in 737.226463ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
9782025-01-17T14:35:03.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 787.414585ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9792025-01-17T14:35:03.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.158309941s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9802025-01-17T14:35:03.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 1.149940408s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9812025-01-17T14:35:04.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 514.162227ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9822025-01-17T14:35:05.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.400536387s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9832025-01-17T14:35:05.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 652.26286ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9842025-01-17T14:35:05.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 577.913172ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9852025-01-17T14:35:06.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 636.439882ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9862025-01-17T14:35:06.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 550.957115ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9872025-01-17T14:35:06.667ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 606.374752ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
9882025-01-17T14:35:07.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 1.473330212s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9892025-01-17T14:35:07.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.275712018s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9902025-01-17T14:35:08.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.198019556s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9912025-01-17T14:35:08.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 1.224149819s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9922025-01-17T14:35:09.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.361696444s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9932025-01-17T14:35:09.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 648.39472ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9942025-01-17T14:35:10.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 719.361492ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9952025-01-17T14:35:10.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.178017096s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9962025-01-17T14:35:11.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 803.023269ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9972025-01-17T14:35:11.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b") failed: Property not found. retry in 1.317564864s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
9982025-01-17T14:35:12.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b") failed: Property not found. retry in 1.117252583s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
9992025-01-17T14:35:13.279ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_72a369c3-a429-46bf-ac7c-aeda1693b3b6
10002025-01-17T14:35:13.279ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_6d3d9a94-4aa4-48b0-b022-3bae548e9e83
10012025-01-17T14:35:13.279ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b
10022025-01-17T14:35:13.279ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_64dde855-ec2d-4160-b218-1425ee65951b
10032025-01-17T14:35:13.279ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_dd6ab4dc-16ad-4009-8b3a-7156558fc1f3
10042025-01-17T14:35:13.279ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10052025-01-17T14:35:13.279ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10062025-01-17T14:35:13.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 22997669 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52916 req_id = 96dd90d7-8593-4485-b4e8-bbfa9655fae6 response_code = 204 uri = /omicron-zones
10072025-01-17T14:35:13.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43624
10082025-01-17T14:35:13.341ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28633 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = ae062477-5b0a-4a68-b7a1-1279f3a2f110 response_code = 500 uri = /cockroachdb
10092025-01-17T14:35:13.341ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ae062477-5b0a-4a68-b7a1-1279f3a2f110", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ae062477-5b0a-4a68-b7a1-1279f3a2f110" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 127.999396ms
10102025-01-17T14:35:13.496ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 2d02ebcf-487b-4c10-acf1-e4aa8f82c0ed response_code = 500 uri = /cockroachdb
10112025-01-17T14:35:13.496ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2d02ebcf-487b-4c10-acf1-e4aa8f82c0ed", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2d02ebcf-487b-4c10-acf1-e4aa8f82c0ed" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 116.001091ms
10122025-01-17T14:35:13.638ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 24648 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 393e5b8e-c108-41fe-8fe6-1dd2689b483e response_code = 500 uri = /cockroachdb
10132025-01-17T14:35:13.639ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "393e5b8e-c108-41fe-8fe6-1dd2689b483e", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "393e5b8e-c108-41fe-8fe6-1dd2689b483e" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 144.751675ms
10142025-01-17T14:35:13.811ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26168 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 18e2ecaf-6b09-475d-934c-0c3cb1f83eb4 response_code = 500 uri = /cockroachdb
10152025-01-17T14:35:13.811ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "18e2ecaf-6b09-475d-934c-0c3cb1f83eb4", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "18e2ecaf-6b09-475d-934c-0c3cb1f83eb4" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 166.136812ms
10162025-01-17T14:35:14.006ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 5d5723d4-7411-4907-aff8-9dbaff053924 response_code = 500 uri = /cockroachdb
10172025-01-17T14:35:14.006ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5d5723d4-7411-4907-aff8-9dbaff053924", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5d5723d4-7411-4907-aff8-9dbaff053924" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 166.104544ms
10182025-01-17T14:35:14.201ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 13ebb35a-1abf-4e49-81e6-64d9aae2d649 response_code = 500 uri = /cockroachdb
10192025-01-17T14:35:14.201ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "13ebb35a-1abf-4e49-81e6-64d9aae2d649", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "13ebb35a-1abf-4e49-81e6-64d9aae2d649" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 368.077534ms
10202025-01-17T14:35:14.601ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 30392 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = a62a8c65-bdb9-4735-abb3-44974c535e22 response_code = 500 uri = /cockroachdb
10212025-01-17T14:35:14.601ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a62a8c65-bdb9-4735-abb3-44974c535e22", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a62a8c65-bdb9-4735-abb3-44974c535e22" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 375.811189ms
10222025-01-17T14:35:15.003ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 11687009-b079-49f6-aa19-e8b712ba3a42 response_code = 500 uri = /cockroachdb
10232025-01-17T14:35:15.003ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "11687009-b079-49f6-aa19-e8b712ba3a42", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "11687009-b079-49f6-aa19-e8b712ba3a42" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 218.44517ms
10242025-01-17T14:35:15.251ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 1c69327a-f0f8-4871-9670-4dda9c06e956 response_code = 500 uri = /cockroachdb
10252025-01-17T14:35:15.252ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1c69327a-f0f8-4871-9670-4dda9c06e956", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1c69327a-f0f8-4871-9670-4dda9c06e956" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 225.187581ms
10262025-01-17T14:35:15.503ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_24a62d67-c163-4832-95fe-9cdc4fd66b9b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25603 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 890b7bf3-ca44-4845-8b66-8d41e97cb85f response_code = 500 uri = /cockroachdb
10272025-01-17T14:35:15.503ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "890b7bf3-ca44-4845-8b66-8d41e97cb85f", "content-length": "124", "date": "Fri, 17 Jan 2025 14:35:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "890b7bf3-ca44-4845-8b66-8d41e97cb85f" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 401.696372ms
10282025-01-17T14:35:15.935ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3752
10292025-01-17T14:35:23.975ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10302025-01-17T14:35:28.768ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10312025-01-17T14:35:28.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 12863756 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43624 req_id = 04d828be-cf87-4b59-8863-3929549c4488 response_code = 204 uri = /cockroachdb
10322025-01-17T14:35:28.773ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52489
10332025-01-17T14:35:28.774ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52489 req_id = 27ae554b-60d6-4932-81bf-2dbac90daae7 response_code = 200 uri = /baseboard
10342025-01-17T14:35:28.785ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 810.070469ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
10352025-01-17T14:35:28.829ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 005036e9-be4e-4ff7-89e2-68e108ae46be (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dbff0acb-5b78-4389-8d1f-3fdacbe97a81 (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ca78ed27-13cf-4207-9a61-681160b3aee9 (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 (service), filesystem_pool: Some(ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 19dbe943-a2e7-451d-9e2b-93e400a6d6bf, kind: Service { id: 5ad3a894-4d4c-4814-97e1-2a43b1fc4d17 }, name: Name("ntp-5ad3a894-4d4c-4814-97e1-2a43b1fc4d17"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 245])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 24a62d67-c163-4832-95fe-9cdc4fd66b9b (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } } } }, OmicronZoneConfig { id: dd6ab4dc-16ad-4009-8b3a-7156558fc1f3 (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } } } }, OmicronZoneConfig { id: 72a369c3-a429-46bf-ac7c-aeda1693b3b6 (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6d3d9a94-4aa4-48b0-b022-3bae548e9e83 (service), filesystem_pool: Some(ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External } } } }, OmicronZoneConfig { id: 64dde855-ec2d-4160-b218-1425ee65951b (service), filesystem_pool: Some(ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 71d6c099-d445-491f-aa89-b1d1f650000e (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: cbd77333-da98-4582-91d1-bc5647e8734c (service), filesystem_pool: Some(ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 2aa4435c-355c-4ea9-b80d-3f16933967df (service), filesystem_pool: Some(ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d792918a-e55a-4fd1-936c-49e64d36bb67 (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: c2f5d930-28f2-46ba-94f7-d055b2d802cb (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } } } }, OmicronZoneConfig { id: e9ecb3b7-3d76-46de-b939-53fefd2c9d3c (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: ca8b4799-0680-473a-bb14-89fa1efe5341 (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: ae227306-b5b5-4979-b61a-2ea7fdad0de3 (service), filesystem_pool: Some(ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5d04b58c-9574-4d69-8a94-d7fec0fbed65 (service), filesystem_pool: Some(ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External } } } }, OmicronZoneConfig { id: c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2 (service), filesystem_pool: Some(ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External } } } }, OmicronZoneConfig { id: d107c97a-bf88-4805-b7c7-705241944ad0 (service), filesystem_pool: Some(ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External } } } }, OmicronZoneConfig { id: b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5 (service), filesystem_pool: Some(ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7ab3f124-5ce0-4f3c-9736-82523b1b1c1c (service), filesystem_pool: Some(ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External } } } }, OmicronZoneConfig { id: 01119664-f36f-409b-a376-12f229e50cc8 (service), filesystem_pool: Some(ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External } } } }, OmicronZoneConfig { id: e3e7d34a-ea4a-40e0-8703-a876b379b7cc (service), filesystem_pool: Some(ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External } } } }, OmicronZoneConfig { id: bc90160f-aa0c-4b37-adf8-d46906a21eec (service), filesystem_pool: Some(ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10362025-01-17T14:35:28.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39242
10372025-01-17T14:35:28.831ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10382025-01-17T14:35:28.831ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10392025-01-17T14:35:28.845ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10402025-01-17T14:35:28.845ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10412025-01-17T14:35:28.854ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10422025-01-17T14:35:28.854ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10432025-01-17T14:35:28.864ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10442025-01-17T14:35:28.864ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452025-01-17T14:35:28.874ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10462025-01-17T14:35:28.874ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472025-01-17T14:35:28.885ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10482025-01-17T14:35:28.885ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492025-01-17T14:35:28.894ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10502025-01-17T14:35:28.894ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10512025-01-17T14:35:28.904ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10522025-01-17T14:35:28.904ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10532025-01-17T14:35:28.914ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10542025-01-17T14:35:28.914ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10552025-01-17T14:35:28.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10562025-01-17T14:35:28.924ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10572025-01-17T14:35:28.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10582025-01-17T14:35:28.934ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10592025-01-17T14:35:28.946ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10602025-01-17T14:35:28.946ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, kind: Crucible }, responder: ... }
10612025-01-17T14:35:28.956ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10622025-01-17T14:35:28.956ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, kind: Crucible }, responder: ... }
10632025-01-17T14:35:28.966ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10642025-01-17T14:35:28.966ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, kind: Crucible }, responder: ... }
10652025-01-17T14:35:28.976ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10662025-01-17T14:35:28.976ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, kind: Crucible }, responder: ... }
10672025-01-17T14:35:28.985ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10682025-01-17T14:35:28.985ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, kind: Crucible }, responder: ... }
10692025-01-17T14:35:28.995ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10702025-01-17T14:35:28.995ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, kind: Crucible }, responder: ... }
10712025-01-17T14:35:29.004ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10722025-01-17T14:35:29.004ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, kind: Crucible }, responder: ... }
10732025-01-17T14:35:29.013ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10742025-01-17T14:35:29.013ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, kind: Crucible }, responder: ... }
10752025-01-17T14:35:29.023ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10762025-01-17T14:35:29.023ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, kind: Crucible }, responder: ... }
10772025-01-17T14:35:29.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10782025-01-17T14:35:29.032ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:177
10792025-01-17T14:35:29.032ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:177
10802025-01-17T14:35:29.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10812025-01-17T14:35:29.151ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10822025-01-17T14:35:29.151ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10832025-01-17T14:35:29.205ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10842025-01-17T14:35:29.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10852025-01-17T14:35:29.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862025-01-17T14:35:29.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10872025-01-17T14:35:29.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10882025-01-17T14:35:29.220ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10892025-01-17T14:35:29.221ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10902025-01-17T14:35:29.221ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10912025-01-17T14:35:29.398ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10922025-01-17T14:35:29.398ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10932025-01-17T14:35:29.459ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10942025-01-17T14:35:29.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-01-17T14:35:29.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10962025-01-17T14:35:29.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10972025-01-17T14:35:29.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982025-01-17T14:35:29.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10992025-01-17T14:35:29.461ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11002025-01-17T14:35:29.462ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5 file = illumos-utils/src/zone.rs:325
11012025-01-17T14:35:29.469ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3 file = illumos-utils/src/zone.rs:325
11022025-01-17T14:35:29.475ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c file = illumos-utils/src/zone.rs:325
11032025-01-17T14:35:29.479ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec file = illumos-utils/src/zone.rs:325
11042025-01-17T14:35:29.485ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2 file = illumos-utils/src/zone.rs:325
11052025-01-17T14:35:29.490ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e file = illumos-utils/src/zone.rs:325
11062025-01-17T14:35:29.495ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341 file = illumos-utils/src/zone.rs:325
11072025-01-17T14:35:29.499ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0 file = illumos-utils/src/zone.rs:325
11082025-01-17T14:35:29.623ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5 file = illumos-utils/src/zone.rs:363
11092025-01-17T14:35:29.629ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3 file = illumos-utils/src/zone.rs:363
11102025-01-17T14:35:29.634ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c file = illumos-utils/src/zone.rs:363
11112025-01-17T14:35:29.640ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec file = illumos-utils/src/zone.rs:363
11122025-01-17T14:35:29.646ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2 file = illumos-utils/src/zone.rs:363
11132025-01-17T14:35:29.652ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e file = illumos-utils/src/zone.rs:363
11142025-01-17T14:35:29.657ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341 file = illumos-utils/src/zone.rs:363
11152025-01-17T14:35:29.663ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0 file = illumos-utils/src/zone.rs:363
11162025-01-17T14:35:29.670ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c file = illumos-utils/src/zone.rs:325
11172025-01-17T14:35:29.676ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8 file = illumos-utils/src/zone.rs:325
11182025-01-17T14:35:29.681ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc file = illumos-utils/src/zone.rs:325
11192025-01-17T14:35:29.687ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb file = illumos-utils/src/zone.rs:325
11202025-01-17T14:35:29.694ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67 file = illumos-utils/src/zone.rs:325
11212025-01-17T14:35:29.701ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65 file = illumos-utils/src/zone.rs:325
11222025-01-17T14:35:29.763ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11232025-01-17T14:35:29.764ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c file = illumos-utils/src/zone.rs:363
11242025-01-17T14:35:29.776ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8 file = illumos-utils/src/zone.rs:363
11252025-01-17T14:35:29.787ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc file = illumos-utils/src/zone.rs:363
11262025-01-17T14:35:29.799ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb file = illumos-utils/src/zone.rs:363
11272025-01-17T14:35:29.810ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67 file = illumos-utils/src/zone.rs:363
11282025-01-17T14:35:29.821ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65 file = illumos-utils/src/zone.rs:363
11292025-01-17T14:35:29.889ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11302025-01-17T14:35:29.951ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11312025-01-17T14:35:30.012ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11322025-01-17T14:35:30.073ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11332025-01-17T14:35:30.075ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11342025-01-17T14:35:30.076ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11352025-01-17T14:35:30.131ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 245, 62]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11362025-01-17T14:35:30.131ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11372025-01-17T14:35:30.134ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11382025-01-17T14:35:30.134ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11392025-01-17T14:35:30.193ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 204, 34]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11402025-01-17T14:35:30.193ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11412025-01-17T14:35:30.194ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11422025-01-17T14:35:30.195ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11432025-01-17T14:35:30.248ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 188, 65]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11442025-01-17T14:35:30.248ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11452025-01-17T14:35:30.251ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11462025-01-17T14:35:30.251ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11472025-01-17T14:35:30.305ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 148, 253]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11482025-01-17T14:35:30.305ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11492025-01-17T14:35:30.307ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11502025-01-17T14:35:30.307ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11512025-01-17T14:35:30.307ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11522025-01-17T14:35:30.307ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11532025-01-17T14:35:30.307ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11542025-01-17T14:35:30.307ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11552025-01-17T14:35:30.309ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11562025-01-17T14:35:30.309ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11572025-01-17T14:35:30.360ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 148, 65]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11582025-01-17T14:35:30.360ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11592025-01-17T14:35:30.360ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11602025-01-17T14:35:30.362ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11612025-01-17T14:35:30.364ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11622025-01-17T14:35:30.364ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11632025-01-17T14:35:30.364ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11642025-01-17T14:35:30.366ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11652025-01-17T14:35:30.571ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11662025-01-17T14:35:30.572ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11672025-01-17T14:35:30.572ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 file = illumos-utils/src/zone.rs:325
11682025-01-17T14:35:30.606ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df file = illumos-utils/src/zone.rs:325
11692025-01-17T14:35:30.640ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c file = illumos-utils/src/zone.rs:325
11702025-01-17T14:35:30.663ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11712025-01-17T14:35:30.663ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11722025-01-17T14:35:30.665ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11732025-01-17T14:35:30.678ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11742025-01-17T14:35:30.678ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 file = illumos-utils/src/zone.rs:363
11752025-01-17T14:35:30.699ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df file = illumos-utils/src/zone.rs:363
11762025-01-17T14:35:30.726ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c file = illumos-utils/src/zone.rs:363
11772025-01-17T14:35:30.737ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11782025-01-17T14:35:30.837ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11792025-01-17T14:35:30.880ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df file = illumos-utils/src/zone.rs:325
11802025-01-17T14:35:30.905ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e file = illumos-utils/src/zone.rs:325
11812025-01-17T14:35:30.920ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df file = illumos-utils/src/zone.rs:363
11822025-01-17T14:35:30.947ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e file = illumos-utils/src/zone.rs:363
11832025-01-17T14:35:39.272ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bce775f0-7684-4ebc-88af-48f4db9b762c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11842025-01-17T14:35:39.316ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8acb3b8b-dfc3-458a-8460-cd250df1ba94'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11852025-01-17T14:35:39.316ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_938658cb-bbce-463a-aa57-19385de71d41/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='eda325ad-2cc5-4d3d-96bb-5ac63c43d96a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11862025-01-17T14:35:39.316ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cbe5a810-e05c-4d89-9519-1329dff4d809/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f76fa9ec-7afd-4429-88d4-ad6c74045473'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11872025-01-17T14:35:39.317ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_29b2ad89-d9a3-465b-9769-46ef936e0689/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='82da6128-8c43-4830-ba48-f667f0ee188d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882025-01-17T14:35:39.317ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9388b4dd-148f-45e0-91e2-9614a3fce0f6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892025-01-17T14:35:39.317ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9ee40d4b-ea13-4a21-b305-42890e26c365/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e603bbef-c061-4489-a399-1ce9eb49ba9e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902025-01-17T14:35:39.334ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='81698da4-e35a-475c-b845-05bf1d160241'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11912025-01-17T14:35:39.334ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
11922025-01-17T14:35:39.377ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dfb17780-e3df-4bb3-93ca-7345897ec266/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b569775a-d1d0-493f-85de-c6cc0f345f28'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932025-01-17T14:35:39.377ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
11942025-01-17T14:35:39.384ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
11952025-01-17T14:35:39.442ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
11962025-01-17T14:35:39.449ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
11972025-01-17T14:35:39.456ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
11982025-01-17T14:35:39.463ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
11992025-01-17T14:35:39.470ZINFOSledAgent (ServiceManager): Booting oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
12002025-01-17T14:35:39.478ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
12012025-01-17T14:35:39.493ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022025-01-17T14:35:39.493ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
12032025-01-17T14:35:39.501ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12042025-01-17T14:35:39.501ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12052025-01-17T14:35:39.501ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
12062025-01-17T14:35:39.507ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
12072025-01-17T14:35:39.887ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12082025-01-17T14:35:39.888ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
12092025-01-17T14:35:39.896ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12102025-01-17T14:35:39.896ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
12112025-01-17T14:35:40.530ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='d792918a-e55a-4fd1-936c-49e64d36bb67'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12122025-01-17T14:35:40.531ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
12132025-01-17T14:35:41.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 35.244634ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
12142025-01-17T14:35:41.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 32.235092ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
12152025-01-17T14:35:41.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 47.626412ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
12162025-01-17T14:35:41.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 37.436175ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
12172025-01-17T14:35:41.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 63.892713ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
12182025-01-17T14:35:41.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 53.741958ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
12192025-01-17T14:35:41.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 33.256739ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
12202025-01-17T14:35:41.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 70.193993ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
12212025-01-17T14:35:41.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 49.381552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
12222025-01-17T14:35:41.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 71.788652ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
12232025-01-17T14:35:41.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 43.477607ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
12242025-01-17T14:35:41.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 46.924585ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
12252025-01-17T14:35:41.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 67.635066ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
12262025-01-17T14:35:41.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 68.442355ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
12272025-01-17T14:35:41.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 106.157119ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
12282025-01-17T14:35:41.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 79.719428ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
12292025-01-17T14:35:41.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 88.271711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
12302025-01-17T14:35:41.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 70.50756ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
12312025-01-17T14:35:41.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 75.195546ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
12322025-01-17T14:35:42.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 57.334754ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
12332025-01-17T14:35:42.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 66.992527ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
12342025-01-17T14:35:42.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 123.807928ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
12352025-01-17T14:35:42.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 65.287939ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
12362025-01-17T14:35:42.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 58.231732ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
12372025-01-17T14:35:42.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 109.373455ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
12382025-01-17T14:35:42.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 104.166556ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
12392025-01-17T14:35:42.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 129.557019ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
12402025-01-17T14:35:42.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 101.111638ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
12412025-01-17T14:35:42.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 147.282261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
12422025-01-17T14:35:42.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 136.902861ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
12432025-01-17T14:35:42.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 164.868426ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
12442025-01-17T14:35:42.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 200.541034ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
12452025-01-17T14:35:42.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 259.535599ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
12462025-01-17T14:35:42.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 298.375849ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
12472025-01-17T14:35:42.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 143.276025ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
12482025-01-17T14:35:42.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 103.24866ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
12492025-01-17T14:35:42.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 165.753965ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
12502025-01-17T14:35:42.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 125.93895ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
12512025-01-17T14:35:42.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 279.7478ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
12522025-01-17T14:35:42.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 247.76134ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
12532025-01-17T14:35:42.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 153.111651ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
12542025-01-17T14:35:42.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 152.466986ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
12552025-01-17T14:35:42.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 295.462989ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
12562025-01-17T14:35:42.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 294.025241ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
12572025-01-17T14:35:42.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 593.613139ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
12582025-01-17T14:35:42.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 298.366803ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
12592025-01-17T14:35:42.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 561.55984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
12602025-01-17T14:35:42.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 252.853219ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
12612025-01-17T14:35:42.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 263.113449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
12622025-01-17T14:35:42.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 494.708854ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
12632025-01-17T14:35:42.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 329.242473ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
12642025-01-17T14:35:42.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 237.49244ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
12652025-01-17T14:35:42.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 257.551361ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
12662025-01-17T14:35:42.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 228.1811ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
12672025-01-17T14:35:42.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 335.009439ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
12682025-01-17T14:35:42.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 541.522983ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
12692025-01-17T14:35:42.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 419.301492ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
12702025-01-17T14:35:42.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 238.185855ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
12712025-01-17T14:35:42.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 299.640348ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
12722025-01-17T14:35:42.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 661.71608ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
12732025-01-17T14:35:42.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 428.718675ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
12742025-01-17T14:35:42.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 321.888133ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
12752025-01-17T14:35:42.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.03965542s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
12762025-01-17T14:35:42.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 1.132334624s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
12772025-01-17T14:35:42.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 1.049896106s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
12782025-01-17T14:35:42.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.17339078s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
12792025-01-17T14:35:42.874ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12802025-01-17T14:35:42.874ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12812025-01-17T14:35:42.874ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12822025-01-17T14:35:42.874ZINFOSledAgent (ServiceManager): Booting oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
12832025-01-17T14:35:42.901ZINFOSledAgent (ServiceManager): Booting oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
12842025-01-17T14:35:42.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 612.749135ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
12852025-01-17T14:35:42.920ZINFOSledAgent (ServiceManager): Booting oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
12862025-01-17T14:35:42.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 1.190993854s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
12872025-01-17T14:35:42.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 786.264962ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
12882025-01-17T14:35:42.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 854.298913ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
12892025-01-17T14:35:42.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 1.170485855s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
12902025-01-17T14:35:43.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.03730998s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
12912025-01-17T14:35:43.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 993.05922ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
12922025-01-17T14:35:43.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 1.045962205s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
12932025-01-17T14:35:43.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 471.647744ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
12942025-01-17T14:35:43.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 656.584988ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
12952025-01-17T14:35:43.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 31.269615ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
12962025-01-17T14:35:43.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 74.633251ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
12972025-01-17T14:35:43.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 131.950004ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
12982025-01-17T14:35:43.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 54.16412ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
12992025-01-17T14:35:43.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 110.970292ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
13002025-01-17T14:35:43.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 94.238431ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
13012025-01-17T14:35:43.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 132.335405ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
13022025-01-17T14:35:43.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 710.452719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
13032025-01-17T14:35:43.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 128.78531ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
13042025-01-17T14:35:43.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 152.239414ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
13052025-01-17T14:35:43.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 341.39586ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
13062025-01-17T14:35:43.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 452.295395ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
13072025-01-17T14:35:43.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 583.010312ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
13082025-01-17T14:35:43.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 261.259623ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
13092025-01-17T14:35:43.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 801.92847ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
13102025-01-17T14:35:43.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 900.852106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
13112025-01-17T14:35:43.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.007731681s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
13122025-01-17T14:35:43.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 574.563815ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
13132025-01-17T14:35:43.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 755.216275ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
13142025-01-17T14:35:43.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 571.46829ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
13152025-01-17T14:35:43.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 978.703084ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
13162025-01-17T14:35:43.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 665.839477ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
13172025-01-17T14:35:43.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 696.163269ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
13182025-01-17T14:35:43.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 929.730287ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
13192025-01-17T14:35:44.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 982.50395ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
13202025-01-17T14:35:44.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.014379858s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
13212025-01-17T14:35:44.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.393098722s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
13222025-01-17T14:35:44.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 1.348875138s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
13232025-01-17T14:35:44.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 1.294318129s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
13242025-01-17T14:35:44.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 531.434055ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
13252025-01-17T14:35:44.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 1.388392923s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
13262025-01-17T14:35:44.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 755.231542ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
13272025-01-17T14:35:44.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 967.290068ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
13282025-01-17T14:35:44.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 677.139978ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
13292025-01-17T14:35:44.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 635.489505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
13302025-01-17T14:35:44.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 821.694784ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
13312025-01-17T14:35:44.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 547.571438ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
13322025-01-17T14:35:44.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 996.296095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
13332025-01-17T14:35:44.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 1.053012988s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
13342025-01-17T14:35:44.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 834.909762ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
13352025-01-17T14:35:44.801ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.545539127s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
13362025-01-17T14:35:44.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.201431785s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
13372025-01-17T14:35:44.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 1.043954762s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
13382025-01-17T14:35:44.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 1.151211779s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
13392025-01-17T14:35:44.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 540.523076ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
13402025-01-17T14:35:45.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 1.074123117s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
13412025-01-17T14:35:45.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.114876308s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
13422025-01-17T14:35:45.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 1.124126941s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
13432025-01-17T14:35:45.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 699.705509ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
13442025-01-17T14:35:45.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 1.165094476s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
13452025-01-17T14:35:45.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 1.28101966s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
13462025-01-17T14:35:45.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 630.251715ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
13472025-01-17T14:35:45.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 538.739462ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
13482025-01-17T14:35:45.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 844.015267ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
13492025-01-17T14:35:45.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.186912399s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
13502025-01-17T14:35:45.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 1.434304419s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
13512025-01-17T14:35:45.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 1.392553937s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
13522025-01-17T14:35:45.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 664.407479ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
13532025-01-17T14:35:45.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 989.086742ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
13542025-01-17T14:35:45.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 1.495791604s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
13552025-01-17T14:35:45.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 930.762587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
13562025-01-17T14:35:45.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 1.132305066s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
13572025-01-17T14:35:45.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 1.218153066s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
13582025-01-17T14:35:46.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.195501683s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
13592025-01-17T14:35:46.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 1.452340677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
13602025-01-17T14:35:46.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 1.347301718s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
13612025-01-17T14:35:46.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 810.044863ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
13622025-01-17T14:35:46.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 863.98538ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
13632025-01-17T14:35:46.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 752.290618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
13642025-01-17T14:35:46.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 1.2945998s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
13652025-01-17T14:35:46.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 1.191828034s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
13662025-01-17T14:35:46.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 1.197916069s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
13672025-01-17T14:35:46.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 537.984446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
13682025-01-17T14:35:46.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 917.315899ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
13692025-01-17T14:35:46.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 688.631792ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
13702025-01-17T14:35:46.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 1.351774122s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
13712025-01-17T14:35:46.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 1.302848984s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
13722025-01-17T14:35:46.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 1.140962183s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
13732025-01-17T14:35:46.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 694.955407ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
13742025-01-17T14:35:47.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.31462794s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
13752025-01-17T14:35:47.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 1.176397745s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
13762025-01-17T14:35:47.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 934.62068ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
13772025-01-17T14:35:47.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 521.926513ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
13782025-01-17T14:35:47.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 1.221194457s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
13792025-01-17T14:35:47.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 810.194424ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
13802025-01-17T14:35:47.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 572.793354ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
13812025-01-17T14:35:47.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 1.362136197s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
13822025-01-17T14:35:47.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 976.64322ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
13832025-01-17T14:35:47.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 613.104944ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
13842025-01-17T14:35:47.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 1.381614975s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
13852025-01-17T14:35:47.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 1.163820135s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
13862025-01-17T14:35:47.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 854.915589ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
13872025-01-17T14:35:47.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 1.264814626s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
13882025-01-17T14:35:47.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 1.047812021s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
13892025-01-17T14:35:47.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 1.19914123s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
13902025-01-17T14:35:47.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 838.919014ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
13912025-01-17T14:35:48.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 1.093521042s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
13922025-01-17T14:35:48.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.153387753s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
13932025-01-17T14:35:48.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 696.422188ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
13942025-01-17T14:35:48.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 1.465667357s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
13952025-01-17T14:35:48.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 702.497265ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
13962025-01-17T14:35:48.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 862.888483ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
13972025-01-17T14:35:48.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 1.236134847s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
13982025-01-17T14:35:48.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 847.558745ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
13992025-01-17T14:35:48.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 1.397840976s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
14002025-01-17T14:35:48.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.308192667s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
14012025-01-17T14:35:48.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 685.202849ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
14022025-01-17T14:35:48.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 1.291056594s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
14032025-01-17T14:35:48.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 1.261022452s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
14042025-01-17T14:35:48.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 1.169082358s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
14052025-01-17T14:35:48.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 1.365673925s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
14062025-01-17T14:35:48.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 828.013258ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
14072025-01-17T14:35:48.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 513.180452ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
14082025-01-17T14:35:48.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 1.03848202s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
14092025-01-17T14:35:48.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 1.312272805s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
14102025-01-17T14:35:48.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 961.195064ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
14112025-01-17T14:35:49.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 1.466113472s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
14122025-01-17T14:35:49.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 773.787764ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
14132025-01-17T14:35:49.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 1.076161632s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
14142025-01-17T14:35:49.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 835.668001ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
14152025-01-17T14:35:49.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.091230273s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
14162025-01-17T14:35:49.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 903.83351ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
14172025-01-17T14:35:49.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 1.459737813s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
14182025-01-17T14:35:49.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 525.007831ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
14192025-01-17T14:35:49.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 1.126090436s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
14202025-01-17T14:35:49.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.063083005s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
14212025-01-17T14:35:49.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 1.22392982s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
14222025-01-17T14:35:49.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 756.531677ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
14232025-01-17T14:35:49.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 727.973577ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
14242025-01-17T14:35:49.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 713.316516ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
14252025-01-17T14:35:49.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 1.258819132s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
14262025-01-17T14:35:50.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 1.198204163s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
14272025-01-17T14:35:50.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 857.985594ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
14282025-01-17T14:35:50.017ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14292025-01-17T14:35:50.017ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
14302025-01-17T14:35:50.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.168093317s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
14312025-01-17T14:35:50.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 644.421553ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
14322025-01-17T14:35:50.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 1.162394263s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
14332025-01-17T14:35:50.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 661.797151ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
14342025-01-17T14:35:50.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 822.078035ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
14352025-01-17T14:35:50.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 33.402679ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
14362025-01-17T14:35:50.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 1.074979751s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
14372025-01-17T14:35:50.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.104723841s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
14382025-01-17T14:35:50.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 145.780681ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
14392025-01-17T14:35:50.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 141.096676ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
14402025-01-17T14:35:50.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 711.345224ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
14412025-01-17T14:35:50.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 1.326523222s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
14422025-01-17T14:35:50.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 1.055786868s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
14432025-01-17T14:35:50.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 823.828939ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
14442025-01-17T14:35:50.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 459.009307ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
14452025-01-17T14:35:50.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 599.881304ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
14462025-01-17T14:35:50.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 1.454905977s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
14472025-01-17T14:35:50.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 856.772001ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
14482025-01-17T14:35:50.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 1.2352776s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
14492025-01-17T14:35:50.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 886.896357ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
14502025-01-17T14:35:50.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 532.575274ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
14512025-01-17T14:35:51.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 1.443135921s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
14522025-01-17T14:35:51.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 1.281991657s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
14532025-01-17T14:35:51.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 752.70528ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
14542025-01-17T14:35:51.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 509.705848ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
14552025-01-17T14:35:51.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 761.996257ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
14562025-01-17T14:35:51.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.082401922s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
14572025-01-17T14:35:51.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 1.042545349s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
14582025-01-17T14:35:51.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 1.401329699s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
14592025-01-17T14:35:51.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 687.51974ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
14602025-01-17T14:35:51.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 607.34031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
14612025-01-17T14:35:51.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 551.830141ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
14622025-01-17T14:35:51.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 733.32548ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
14632025-01-17T14:35:51.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 1.065715388s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
14642025-01-17T14:35:51.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.44290253s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
14652025-01-17T14:35:51.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 1.108962698s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
14662025-01-17T14:35:51.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 1.057845306s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
14672025-01-17T14:35:51.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 693.349963ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
14682025-01-17T14:35:51.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 601.005548ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
14692025-01-17T14:35:52.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 1.088371827s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
14702025-01-17T14:35:52.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 618.641418ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
14712025-01-17T14:35:52.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.368578109s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
14722025-01-17T14:35:52.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 819.272773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
14732025-01-17T14:35:52.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 1.162989212s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
14742025-01-17T14:35:52.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 1.488913193s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
14752025-01-17T14:35:52.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 1.324927349s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
14762025-01-17T14:35:52.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 1.074528745s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
14772025-01-17T14:35:52.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 660.282699ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
14782025-01-17T14:35:52.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 520.938583ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
14792025-01-17T14:35:52.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 1.405578492s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
14802025-01-17T14:35:52.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 803.853992ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
14812025-01-17T14:35:52.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 636.976177ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
14822025-01-17T14:35:52.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 1.105121522s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
14832025-01-17T14:35:52.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 790.455119ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
14842025-01-17T14:35:52.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 1.04375137s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
14852025-01-17T14:35:52.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 987.667677ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
14862025-01-17T14:35:52.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 1.018233773s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
14872025-01-17T14:35:52.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 1.184756041s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
14882025-01-17T14:35:52.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 526.368167ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
14892025-01-17T14:35:52.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 909.817223ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
14902025-01-17T14:35:53.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.343340788s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
14912025-01-17T14:35:53.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 599.042027ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
14922025-01-17T14:35:53.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.037613354s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
14932025-01-17T14:35:53.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 1.470733904s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
14942025-01-17T14:35:53.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 604.23676ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
14952025-01-17T14:35:53.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 1.096544062s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
14962025-01-17T14:35:53.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 667.838287ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
14972025-01-17T14:35:53.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 547.914308ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
14982025-01-17T14:35:53.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 870.078765ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
14992025-01-17T14:35:53.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 1.172059041s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
15002025-01-17T14:35:53.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 565.413601ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
15012025-01-17T14:35:53.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 1.237180348s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
15022025-01-17T14:35:53.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 1.055976117s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
15032025-01-17T14:35:53.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 656.818684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
15042025-01-17T14:35:53.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 541.527649ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
15052025-01-17T14:35:53.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 648.824371ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
15062025-01-17T14:35:53.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 1.073580854s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
15072025-01-17T14:35:53.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 1.057824282s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
15082025-01-17T14:35:53.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 1.238631804s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
15092025-01-17T14:35:53.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 1.395670505s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
15102025-01-17T14:35:53.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 894.174699ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
15112025-01-17T14:35:54.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 738.826499ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
15122025-01-17T14:35:54.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.132497468s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
15132025-01-17T14:35:54.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 1.347860607s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
15142025-01-17T14:35:54.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.331034454s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
15152025-01-17T14:35:54.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 1.078651814s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
15162025-01-17T14:35:54.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 1.2473353s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
15172025-01-17T14:35:54.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.361980901s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
15182025-01-17T14:35:54.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 1.043697024s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
15192025-01-17T14:35:54.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 567.612755ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
15202025-01-17T14:35:54.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 955.22692ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
15212025-01-17T14:35:54.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 1.358087672s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
15222025-01-17T14:35:54.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 938.124276ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
15232025-01-17T14:35:54.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 907.022755ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
15242025-01-17T14:35:54.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 861.776401ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
15252025-01-17T14:35:54.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8") failed: Property not found. retry in 1.090607449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
15262025-01-17T14:35:54.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 1.399058413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
15272025-01-17T14:35:54.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 982.347277ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
15282025-01-17T14:35:54.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 526.099975ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
15292025-01-17T14:35:55.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 643.163881ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
15302025-01-17T14:35:55.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 876.471171ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
15312025-01-17T14:35:55.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67") failed: Property not found. retry in 1.219909841s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
15322025-01-17T14:35:55.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e") failed: Property not found. retry in 570.362516ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
15332025-01-17T14:35:55.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 966.560699ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
15342025-01-17T14:35:55.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 944.915735ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
15352025-01-17T14:35:55.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc") failed: Property not found. retry in 1.313916785s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
15362025-01-17T14:35:55.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df") failed: Property not found. retry in 1.385028467s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
15372025-01-17T14:35:55.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 594.275419ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
15382025-01-17T14:35:55.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341") failed: Property not found. retry in 1.359648293s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
15392025-01-17T14:35:55.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.101365373s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
15402025-01-17T14:35:55.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 860.872742ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
15412025-01-17T14:35:55.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c") failed: Property not found. retry in 1.363713148s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
15422025-01-17T14:35:55.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 837.270771ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
15432025-01-17T14:35:55.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 895.013579ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
15442025-01-17T14:35:55.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65") failed: Property not found. retry in 1.224642458s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
15452025-01-17T14:35:55.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c") failed: Property not found. retry in 1.365201445s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
15462025-01-17T14:35:56.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec") failed: Property not found. retry in 1.414509993s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
15472025-01-17T14:35:56.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3") failed: Property not found. retry in 1.178986362s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
15482025-01-17T14:35:56.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e") failed: Property not found. retry in 1.050843885s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
15492025-01-17T14:35:56.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2") failed: Property not found. retry in 1.128514296s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
15502025-01-17T14:35:56.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7") failed: Property not found. retry in 1.150985046s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
15512025-01-17T14:35:56.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0") failed: Property not found. retry in 1.29835043s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
15522025-01-17T14:35:56.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c") failed: Property not found. retry in 991.738307ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
15532025-01-17T14:35:56.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 1.340387762s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
15542025-01-17T14:35:56.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df") failed: Property not found. retry in 594.330714ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
15552025-01-17T14:35:56.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5") failed: Property not found. retry in 1.002387087s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
15562025-01-17T14:35:57.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 918.037102ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
15572025-01-17T14:35:58.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 717.375122ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
15582025-01-17T14:35:58.921ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34086
15592025-01-17T14:35:58.931ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1321 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34086 req_id = 0812ef96-aad7-46e6-9e48-4280602c588f response_code = 200 uri = /baseboard
15602025-01-17T14:35:59.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb") failed: Property not found. retry in 570.715019ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
15612025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_b8783ce2-2eac-4c80-a326-1ebc5d3dd4b5
15622025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7
15632025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_ae227306-b5b5-4979-b61a-2ea7fdad0de3
15642025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_e9ecb3b7-3d76-46de-b939-53fefd2c9d3c
15652025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_bc90160f-aa0c-4b37-adf8-d46906a21eec
15662025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_c0bfd6e0-1384-41cf-a8f1-b3f157e76bf2
15672025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_6f3cffd0-918e-4673-9c50-0e56a1b692df
15682025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_5381c5b5-cba9-4b9d-8a5d-7d7bfd899a3e
15692025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_ca8b4799-0680-473a-bb14-89fa1efe5341
15702025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_d107c97a-bf88-4805-b7c7-705241944ad0
15712025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_7ab3f124-5ce0-4f3c-9736-82523b1b1c1c
15722025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_cbd77333-da98-4582-91d1-bc5647e8734c
15732025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_01119664-f36f-409b-a376-12f229e50cc8
15742025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_e3e7d34a-ea4a-40e0-8703-a876b379b7cc
15752025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_c2f5d930-28f2-46ba-94f7-d055b2d802cb
15762025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_d792918a-e55a-4fd1-936c-49e64d36bb67
15772025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_5d04b58c-9574-4d69-8a94-d7fec0fbed65
15782025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_71d6c099-d445-491f-aa89-b1d1f650000e
15792025-01-17T14:36:00.210ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_2aa4435c-355c-4ea9-b80d-3f16933967df
15802025-01-17T14:36:00.211ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15812025-01-17T14:36:00.218ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15822025-01-17T14:36:00.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31393791 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39242 req_id = 46c76fae-64fc-424f-bdb8-39dffd02787b response_code = 204 uri = /omicron-zones
15832025-01-17T14:36:00.236ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
15842025-01-17T14:36:00.245ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15852025-01-17T14:36:00.256ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:803
15862025-01-17T14:36:00.318ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
15872025-01-17T14:36:00.334ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15882025-01-17T14:36:00.403ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15892025-01-17T14:36:00.529ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15902025-01-17T14:36:00.732ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15912025-01-17T14:36:00.973ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15922025-01-17T14:36:01.126ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15932025-01-17T14:36:01.282ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15942025-01-17T14:36:01.627ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15952025-01-17T14:36:02.099ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15962025-01-17T14:36:02.486ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.575500635s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
15972025-01-17T14:36:02.688ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15982025-01-17T14:36:03.049ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15992025-01-17T14:36:03.927ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16002025-01-17T14:36:04.689ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c10eee8e-2a1a-453f-9423-f97cd0150eaa/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16012025-01-17T14:36:06.020ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "dc12f32b-ed02-4601-bbae-af06e9907949", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c10eee8e-2a1a-453f-9423-f97cd0150eaa\"", request_id: "dc12f32b-ed02-4601-bbae-af06e9907949" } file = sled-agent/src/rack_setup/service.rs:1079
16022025-01-17T14:36:08.299ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "84e190e7-599d-46c6-94f5-f57533cd33d0", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:08 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "84e190e7-599d-46c6-94f5-f57533cd33d0" } file = sled-agent/src/rack_setup/service.rs:1079
16032025-01-17T14:36:10.631ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a3293b38-a49e-4b20-8850-65bd334a1078", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "a3293b38-a49e-4b20-8850-65bd334a1078" } file = sled-agent/src/rack_setup/service.rs:1079
16042025-01-17T14:36:12.115ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5027b480-860b-47f0-b524-f5a6183e67a0", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "5027b480-860b-47f0-b524-f5a6183e67a0" } file = sled-agent/src/rack_setup/service.rs:1079
16052025-01-17T14:36:14.663ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c870720b-fd26-4790-887c-d5210f5b912f", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "c870720b-fd26-4790-887c-d5210f5b912f" } file = sled-agent/src/rack_setup/service.rs:1079
16062025-01-17T14:36:16.408ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a91baa37-ba2c-4c1e-b342-e336c03ae8c5", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "a91baa37-ba2c-4c1e-b342-e336c03ae8c5" } file = sled-agent/src/rack_setup/service.rs:1079
16072025-01-17T14:36:18.792ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "104ab744-0026-4e76-9a56-fdbb15c28d3a", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "104ab744-0026-4e76-9a56-fdbb15c28d3a" } file = sled-agent/src/rack_setup/service.rs:1079
16082025-01-17T14:36:21.463ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7b74eede-885b-47de-92eb-1e8d2d853f4b", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "7b74eede-885b-47de-92eb-1e8d2d853f4b" } file = sled-agent/src/rack_setup/service.rs:1079
16092025-01-17T14:36:25.905ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fa5ca61d-321e-4c0f-8701-e6f922dab8c3", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "fa5ca61d-321e-4c0f-8701-e6f922dab8c3" } file = sled-agent/src/rack_setup/service.rs:1079
16102025-01-17T14:36:28.979ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61712
16112025-01-17T14:36:28.980ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61712 req_id = f13c044e-8d85-4fe3-b617-26f87441fb9f response_code = 200 uri = /baseboard
16122025-01-17T14:36:30.045ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5f1deb54-b3f9-439e-9132-e28c85198966", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "5f1deb54-b3f9-439e-9132-e28c85198966" } file = sled-agent/src/rack_setup/service.rs:1079
16132025-01-17T14:36:36.499ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0f17181b-7ec4-4da5-b467-b9764096b45f", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "0f17181b-7ec4-4da5-b467-b9764096b45f" } file = sled-agent/src/rack_setup/service.rs:1079
16142025-01-17T14:36:41.959ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "be49bf5b-aadb-43a8-a911-cabb21751eca", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "be49bf5b-aadb-43a8-a911-cabb21751eca" } file = sled-agent/src/rack_setup/service.rs:1079
16152025-01-17T14:36:49.859ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:58824 remote_addr = [fd00:1122:3344:101::d]:45374 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
16162025-01-17T14:36:49.884ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 24179 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 38cbbbd3-88ce-458c-8756-a7fee4e9f583 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
16172025-01-17T14:36:50.507ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2466027e-c59d-4a13-a722-0c46d0a974f0", "content-length": "173", "date": "Fri, 17 Jan 2025 14:36:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca190028-ca00-4273-bff2-dd6ceb9e6ccb\"", request_id: "2466027e-c59d-4a13-a722-0c46d0a974f0" } file = sled-agent/src/rack_setup/service.rs:1079
16182025-01-17T14:36:50.883ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
16192025-01-17T14:36:50.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52850
16202025-01-17T14:36:50.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16212025-01-17T14:36:50.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16222025-01-17T14:36:50.970ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:177
16232025-01-17T14:36:50.972ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:177
16242025-01-17T14:36:50.985ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16252025-01-17T14:36:50.985ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e
16262025-01-17T14:36:51.009ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16272025-01-17T14:36:51.009ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70
16282025-01-17T14:36:51.033ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16292025-01-17T14:36:51.033ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40
16302025-01-17T14:36:51.054ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16312025-01-17T14:36:51.054ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbe5a810-e05c-4d89-9519-1329dff4d809
16322025-01-17T14:36:51.075ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16332025-01-17T14:36:51.075ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dfb17780-e3df-4bb3-93ca-7345897ec266
16342025-01-17T14:36:51.098ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16352025-01-17T14:36:51.098ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5
16362025-01-17T14:36:51.120ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16372025-01-17T14:36:51.120ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29b2ad89-d9a3-465b-9769-46ef936e0689
16382025-01-17T14:36:51.143ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16392025-01-17T14:36:51.143ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ee40d4b-ea13-4a21-b305-42890e26c365
16402025-01-17T14:36:51.163ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16412025-01-17T14:36:51.163ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_938658cb-bbce-463a-aa57-19385de71d41
16422025-01-17T14:36:51.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209813 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52850 req_id = 460d585d-a910-48af-8565-044bbf8f47fa response_code = 200 uri = /inventory
16432025-01-17T14:36:59.012ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60893
16442025-01-17T14:36:59.012ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60893 req_id = 3d1fe936-1df3-4c45-af53-3cb6b500066d response_code = 200 uri = /baseboard
16452025-01-17T14:37:02.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57398
16462025-01-17T14:37:02.447ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16472025-01-17T14:37:02.447ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16482025-01-17T14:37:02.447ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16492025-01-17T14:37:02.447ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16502025-01-17T14:37:02.447ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16512025-01-17T14:37:02.447ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16522025-01-17T14:37:02.447ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16532025-01-17T14:37:02.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57398 req_id = 9e6dc88b-9ebb-4c3d-88ce-21a2ab5341b5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16542025-01-17T14:37:02.449ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
16552025-01-17T14:37:02.453ZINFOSledAgent (RSS): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16562025-01-17T14:37:02.453ZINFOSledAgent (RSS): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16572025-01-17T14:37:02.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44334
16582025-01-17T14:37:02.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16592025-01-17T14:37:02.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16602025-01-17T14:37:02.646ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:177
16612025-01-17T14:37:02.646ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:177
16622025-01-17T14:37:02.659ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16632025-01-17T14:37:02.659ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e
16642025-01-17T14:37:02.680ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16652025-01-17T14:37:02.680ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70
16662025-01-17T14:37:02.702ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16672025-01-17T14:37:02.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40
16682025-01-17T14:37:02.721ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16692025-01-17T14:37:02.721ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbe5a810-e05c-4d89-9519-1329dff4d809
16702025-01-17T14:37:02.741ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16712025-01-17T14:37:02.741ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dfb17780-e3df-4bb3-93ca-7345897ec266
16722025-01-17T14:37:02.765ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16732025-01-17T14:37:02.765ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5
16742025-01-17T14:37:02.785ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16752025-01-17T14:37:02.785ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29b2ad89-d9a3-465b-9769-46ef936e0689
16762025-01-17T14:37:02.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35789
16772025-01-17T14:37:02.789ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16782025-01-17T14:37:02.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16792025-01-17T14:37:02.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16802025-01-17T14:37:02.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16812025-01-17T14:37:02.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16822025-01-17T14:37:02.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16832025-01-17T14:37:02.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16842025-01-17T14:37:02.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 774 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35789 req_id = ec7a12b1-3a73-4927-8cb7-28d14e7dce89 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16852025-01-17T14:37:02.805ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16862025-01-17T14:37:02.805ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ee40d4b-ea13-4a21-b305-42890e26c365
16872025-01-17T14:37:02.824ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16882025-01-17T14:37:02.824ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_938658cb-bbce-463a-aa57-19385de71d41
16892025-01-17T14:37:02.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193039 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44334 req_id = 4ea00e23-3817-4b6c-a15f-3710438727cc response_code = 200 uri = /inventory
16902025-01-17T14:37:03.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60773
16912025-01-17T14:37:03.166ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16922025-01-17T14:37:03.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16932025-01-17T14:37:03.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16942025-01-17T14:37:03.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16952025-01-17T14:37:03.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16962025-01-17T14:37:03.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16972025-01-17T14:37:03.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16982025-01-17T14:37:03.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60773 req_id = a021618d-3d6b-4879-974f-a7f1402cb236 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16992025-01-17T14:37:03.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33323
17002025-01-17T14:37:03.192ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17012025-01-17T14:37:03.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17022025-01-17T14:37:03.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17032025-01-17T14:37:03.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17042025-01-17T14:37:03.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17052025-01-17T14:37:03.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17062025-01-17T14:37:03.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17072025-01-17T14:37:03.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33323 req_id = e8bbc7be-f139-43c2-acd3-fdc23e2a0e43 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17082025-01-17T14:37:06.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44527
17092025-01-17T14:37:06.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44527 req_id = a358ed61-047f-44d6-840c-184810bab3ba response_code = 200 uri = /vpc-routes
17102025-01-17T14:37:06.923ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
17112025-01-17T14:37:06.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 756 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44527 req_id = 4f1a451d-7f93-490d-be54-de97d0944b53 response_code = 204 uri = /eip-gateways
17122025-01-17T14:37:06.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40979
17132025-01-17T14:37:06.993ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17142025-01-17T14:37:07.110ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17152025-01-17T14:37:07.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40979 req_id = 074e671a-ad24-43d8-821f-4312415f8a44 response_code = 204 uri = /switch-ports
17162025-01-17T14:37:07.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58275
17172025-01-17T14:37:07.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55508
17182025-01-17T14:37:07.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58275 req_id = d57458e9-ccd8-4f0e-be10-5ab775983332 response_code = 200 uri = /vpc-routes
17192025-01-17T14:37:07.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1027 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55508 req_id = 0664d257-271a-40e6-9588-d6c875199fa1 response_code = 200 uri = /v2p
17202025-01-17T14:37:07.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3806 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44527 req_id = 6053e39e-ac42-4787-9dab-6bd504452161 response_code = 204 uri = /vpc-routes
17212025-01-17T14:37:07.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4438 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40979 req_id = 45a18f16-d8f2-4f18-999a-998847e161f6 response_code = 200 uri = /network-bootstore-config
17222025-01-17T14:37:07.280ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17232025-01-17T14:37:07.280ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17242025-01-17T14:37:07.282ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17252025-01-17T14:37:07.282ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17262025-01-17T14:37:07.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3591 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40979 req_id = f3da9abd-8e1b-43bd-8cbc-57139185136a response_code = 204 uri = /network-bootstore-config
17272025-01-17T14:37:07.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41308
17282025-01-17T14:37:07.316ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17292025-01-17T14:37:07.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17302025-01-17T14:37:07.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41308 req_id = 24058c55-8f69-4178-8855-afeac57538ae response_code = 204 uri = /switch-ports
17312025-01-17T14:37:07.428ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
17322025-01-17T14:37:07.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58275 req_id = ced8ed6a-7412-4e27-a918-7b229ce0623f response_code = 204 uri = /eip-gateways
17332025-01-17T14:37:07.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41308 req_id = 742931da-fdf1-4fe2-bd15-19e48e6cdf10 response_code = 200 uri = /network-bootstore-config
17342025-01-17T14:37:07.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59482
17352025-01-17T14:37:07.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59482 req_id = 6c7232e9-3ae2-4fc6-8f73-e5bacf535c61 response_code = 200 uri = /v2p
17362025-01-17T14:37:07.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52253
17372025-01-17T14:37:07.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52253 req_id = d3ef90b4-32f3-45ee-a84d-80aff5889aaf response_code = 200 uri = /vpc-routes
17382025-01-17T14:37:07.701ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
17392025-01-17T14:37:07.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58275 req_id = 397db5cd-3a01-4f3d-bae1-9ca7aefd6c15 response_code = 204 uri = /vpc-routes
17402025-01-17T14:37:07.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
17412025-01-17T14:37:07.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52253 req_id = 016816e6-ae90-4a9e-87d9-e903046d3bfb response_code = 204 uri = /eip-gateways
17422025-01-17T14:37:07.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50822
17432025-01-17T14:37:07.761ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17442025-01-17T14:37:07.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17452025-01-17T14:37:07.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104913 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50822 req_id = 4a9a2ce7-66d1-4388-afb0-7ab7ab4bab8d response_code = 204 uri = /switch-ports
17462025-01-17T14:37:07.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36301
17472025-01-17T14:37:07.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36301 req_id = 1a72a289-2b08-44c4-976f-fdcd19acea29 response_code = 200 uri = /v2p
17482025-01-17T14:37:07.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50822 req_id = 1624a43b-4461-4c5c-98eb-fdce5f71063c response_code = 200 uri = /network-bootstore-config
17492025-01-17T14:37:07.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52253 req_id = 6548fbcf-e406-4e56-8174-d18a3407277c response_code = 204 uri = /vpc-routes
17502025-01-17T14:37:12.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55079
17512025-01-17T14:37:12.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55079 req_id = 56522099-eb06-41ed-aa08-7cd530ed1198 response_code = 200 uri = /vpc-routes
17522025-01-17T14:37:12.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
17532025-01-17T14:37:12.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55079 req_id = a2499118-784c-42c7-85d3-ac690768c8fd response_code = 204 uri = /eip-gateways
17542025-01-17T14:37:12.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55079 req_id = 41c16eb5-bc70-439c-a747-9888c7d3500a response_code = 204 uri = /vpc-routes
17552025-01-17T14:37:19.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5474 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 80deb04d-73d0-4137-b236-d8870f4996b8 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
17562025-01-17T14:37:29.044ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60265
17572025-01-17T14:37:29.044ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60265 req_id = aa5d3afc-9ed9-4eed-9272-6e5ed65540a3 response_code = 200 uri = /baseboard
17582025-01-17T14:37:36.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61839
17592025-01-17T14:37:36.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61839 req_id = b29d0ba8-2837-4221-a7ee-0ebef80ffee9 response_code = 200 uri = /vpc-routes
17602025-01-17T14:37:36.369ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
17612025-01-17T14:37:36.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61839 req_id = ac3f692f-e57b-4385-9d31-da560a55005d response_code = 204 uri = /eip-gateways
17622025-01-17T14:37:36.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61839 req_id = 588813ae-7391-4393-a5f8-bacf4a8e6a72 response_code = 204 uri = /vpc-routes
17632025-01-17T14:37:36.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33970
17642025-01-17T14:37:36.445ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17652025-01-17T14:37:36.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17662025-01-17T14:37:36.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97218 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33970 req_id = d86490fb-bb7c-4efb-8a38-b58b43bf1a4e response_code = 204 uri = /switch-ports
17672025-01-17T14:37:36.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40306
17682025-01-17T14:37:36.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40306 req_id = 66a0c4c5-5ff8-474e-8ccd-b1948c0dc3bb response_code = 200 uri = /v2p
17692025-01-17T14:37:36.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33970 req_id = 6e77be09-7027-4d77-9172-5b04359a31be response_code = 200 uri = /network-bootstore-config
17702025-01-17T14:37:36.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62981
17712025-01-17T14:37:36.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62981 req_id = 940f1c22-097a-4885-b19d-238282950fff response_code = 200 uri = /vpc-routes
17722025-01-17T14:37:37.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58848
17732025-01-17T14:37:37.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58848 req_id = c67be8fe-0c05-4f18-ac39-69e640d8fde6 response_code = 200 uri = /v2p
17742025-01-17T14:37:37.041ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
17752025-01-17T14:37:37.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62981 req_id = 0b536c4b-ff84-45d8-9d5e-c8bb384dfd34 response_code = 204 uri = /eip-gateways
17762025-01-17T14:37:37.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62981 req_id = ac29c36f-5bed-4baf-9f34-87e2c3a71bf3 response_code = 204 uri = /vpc-routes
17772025-01-17T14:37:37.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61311
17782025-01-17T14:37:37.129ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17792025-01-17T14:37:37.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17802025-01-17T14:37:37.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128900 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61311 req_id = f351ee19-e39d-4e4c-b71e-40692a1cbc3d response_code = 204 uri = /switch-ports
17812025-01-17T14:37:37.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61311 req_id = 479ef178-f516-4beb-8016-a28e63cc4940 response_code = 200 uri = /network-bootstore-config
17822025-01-17T14:37:37.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34207
17832025-01-17T14:37:37.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34207 req_id = e487543f-db8f-4751-abef-43a200487f47 response_code = 200 uri = /v2p
17842025-01-17T14:37:37.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36271
17852025-01-17T14:37:37.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36271 req_id = 29e03a43-b857-4a30-99e5-2626f33e7e14 response_code = 200 uri = /vpc-routes
17862025-01-17T14:37:37.558ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
17872025-01-17T14:37:37.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36271 req_id = 38d28413-2882-4608-9450-09845f09285c response_code = 204 uri = /eip-gateways
17882025-01-17T14:37:37.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36318
17892025-01-17T14:37:37.567ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17902025-01-17T14:37:37.608ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17912025-01-17T14:37:37.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95482 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36318 req_id = c45ff2fa-50fe-4042-b5d6-ae55addb8f05 response_code = 204 uri = /switch-ports
17922025-01-17T14:37:37.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36318 req_id = b386a194-6d63-4ad6-8e15-c61a54d6d69a response_code = 200 uri = /network-bootstore-config
17932025-01-17T14:37:37.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 465 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36271 req_id = 925c0efe-103e-431a-b19c-80fd61c862f4 response_code = 204 uri = /vpc-routes
17942025-01-17T14:37:49.865ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8077 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = f785d895-45f3-4030-8efa-81e57b81cc8a response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
17952025-01-17T14:37:59.078ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47782
17962025-01-17T14:37:59.078ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47782 req_id = 1f12ef31-1bbc-43f7-b1c1-11155e79cac1 response_code = 200 uri = /baseboard
17972025-01-17T14:38:06.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38257
17982025-01-17T14:38:06.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38257 req_id = fa3f0487-e2d3-410d-a1a8-587084eedffd response_code = 200 uri = /vpc-routes
17992025-01-17T14:38:06.690ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
18002025-01-17T14:38:06.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38257 req_id = 5de3933d-255d-40b1-8b87-deae701ff38b response_code = 204 uri = /eip-gateways
18012025-01-17T14:38:06.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38257 req_id = e4ac52fc-f62e-48de-87ca-019b2f8cc4a4 response_code = 204 uri = /vpc-routes
18022025-01-17T14:38:06.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64526
18032025-01-17T14:38:06.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64526 req_id = 81949584-e514-4b20-9301-2cd054b88b6f response_code = 200 uri = /v2p
18042025-01-17T14:38:06.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46274
18052025-01-17T14:38:06.875ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18062025-01-17T14:38:06.923ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18072025-01-17T14:38:06.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117016 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46274 req_id = 763c3296-91f9-47c0-968b-bd4b9f8f57b0 response_code = 204 uri = /switch-ports
18082025-01-17T14:38:06.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46274 req_id = dfbd224f-915e-4b32-9628-9c7a503e479d response_code = 200 uri = /network-bootstore-config
18092025-01-17T14:38:07.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33337
18102025-01-17T14:38:07.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33337 req_id = 1e7c13b8-8c8c-4337-ba59-3b332fc9cea2 response_code = 200 uri = /vpc-routes
18112025-01-17T14:38:07.272ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
18122025-01-17T14:38:07.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33337 req_id = 8558eba4-0fe9-4e28-a583-0397d9763aba response_code = 204 uri = /eip-gateways
18132025-01-17T14:38:07.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65364
18142025-01-17T14:38:07.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65364 req_id = 629b4056-d4a6-4721-ab81-4e59bd23293e response_code = 200 uri = /v2p
18152025-01-17T14:38:07.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33337 req_id = cbc5a322-78d1-4e13-96e6-db9381f7ee9f response_code = 204 uri = /vpc-routes
18162025-01-17T14:38:07.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41486
18172025-01-17T14:38:07.468ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18182025-01-17T14:38:07.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18192025-01-17T14:38:07.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41486 req_id = 3b5ab5a5-5684-4a18-a3e5-30f14eeae365 response_code = 204 uri = /switch-ports
18202025-01-17T14:38:07.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52549
18212025-01-17T14:38:07.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52549 req_id = 6171a218-ac26-4195-ad14-ee50b3403351 response_code = 200 uri = /vpc-routes
18222025-01-17T14:38:07.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41486 req_id = 648faf4b-cc4b-47b0-81c0-354a5462695a response_code = 200 uri = /network-bootstore-config
18232025-01-17T14:38:07.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
18242025-01-17T14:38:07.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52549 req_id = 4a4ecdac-368d-4119-a1da-a4d3f7d1034a response_code = 204 uri = /eip-gateways
18252025-01-17T14:38:07.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56762
18262025-01-17T14:38:07.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56762 req_id = 43a9f071-6d4a-4185-a7b5-091f23bf8623 response_code = 200 uri = /v2p
18272025-01-17T14:38:07.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52549 req_id = 39d77fbd-647e-4ae6-867d-0a7a3ce0b412 response_code = 204 uri = /vpc-routes
18282025-01-17T14:38:07.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43324
18292025-01-17T14:38:07.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18302025-01-17T14:38:07.760ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18312025-01-17T14:38:07.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93581 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43324 req_id = 1c88bd78-57a6-4f73-806a-6c00757f736a response_code = 204 uri = /switch-ports
18322025-01-17T14:38:07.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43324 req_id = 1b02f8be-3d6e-447c-a133-6476061a4176 response_code = 200 uri = /network-bootstore-config
18332025-01-17T14:38:19.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6638 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 7c080aa2-5a39-4681-9765-5cba627e7bb5 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
18342025-01-17T14:38:29.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34562
18352025-01-17T14:38:29.112ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34562 req_id = 50aa9f38-0338-4698-ba85-df5ea194365d response_code = 200 uri = /baseboard
18362025-01-17T14:38:36.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48472
18372025-01-17T14:38:36.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48472 req_id = 0c11d9b7-b372-4ded-92a9-0b1b2c988712 response_code = 200 uri = /vpc-routes
18382025-01-17T14:38:36.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49520
18392025-01-17T14:38:36.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49520 req_id = 6ab0e85b-eb07-424e-bf63-d11af59d56bb response_code = 200 uri = /v2p
18402025-01-17T14:38:36.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40199
18412025-01-17T14:38:36.596ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18422025-01-17T14:38:36.634ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18432025-01-17T14:38:36.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40199 req_id = bb9f7920-1944-4e6a-8f6b-5fb2a80bc7b6 response_code = 204 uri = /switch-ports
18442025-01-17T14:38:36.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
18452025-01-17T14:38:36.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48472 req_id = b9216f60-f2af-4501-a9de-df6f4175a17e response_code = 204 uri = /eip-gateways
18462025-01-17T14:38:36.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40199 req_id = 1b4eb854-ed81-483b-a23b-3fcebc4c0569 response_code = 200 uri = /network-bootstore-config
18472025-01-17T14:38:36.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48472 req_id = 9600eaed-4f89-4600-8c00-e639a67b51a2 response_code = 204 uri = /vpc-routes
18482025-01-17T14:38:36.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45598
18492025-01-17T14:38:36.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45598 req_id = bd54b9c7-bf34-4fd5-af20-861fbc4b6fbc response_code = 200 uri = /vpc-routes
18502025-01-17T14:38:37.009ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
18512025-01-17T14:38:37.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45598 req_id = 8da39348-b205-4a7f-a801-5dd2156fb217 response_code = 204 uri = /eip-gateways
18522025-01-17T14:38:37.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45598 req_id = dc5ac6b7-9a0b-4871-86c2-7999cf981cea response_code = 204 uri = /vpc-routes
18532025-01-17T14:38:37.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53517
18542025-01-17T14:38:37.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53517 req_id = 8452dff4-b375-433c-9be4-c6a1b47d4ea4 response_code = 200 uri = /v2p
18552025-01-17T14:38:37.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49388
18562025-01-17T14:38:37.157ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18572025-01-17T14:38:37.209ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18582025-01-17T14:38:37.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49388 req_id = ac47fab7-0b99-4d10-8a81-4d9a16f604ff response_code = 204 uri = /switch-ports
18592025-01-17T14:38:37.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49388 req_id = 7278eadd-321d-4412-be7d-8a0c866d9533 response_code = 200 uri = /network-bootstore-config
18602025-01-17T14:38:37.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43253
18612025-01-17T14:38:37.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43253 req_id = 7e8d651f-682a-4c6a-b33a-2de778071225 response_code = 200 uri = /vpc-routes
18622025-01-17T14:38:37.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
18632025-01-17T14:38:37.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43253 req_id = 9280281c-7025-4cde-b549-38f005c11470 response_code = 204 uri = /eip-gateways
18642025-01-17T14:38:37.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43253 req_id = 4f86a1f7-e9fb-42e1-9935-f09b89aa15c0 response_code = 204 uri = /vpc-routes
18652025-01-17T14:38:37.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56892
18662025-01-17T14:38:37.493ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18672025-01-17T14:38:37.529ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18682025-01-17T14:38:37.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56892 req_id = 6d8853b4-3b26-4e1c-b737-f097adcaad49 response_code = 204 uri = /switch-ports
18692025-01-17T14:38:37.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56892 req_id = 49401159-efe4-4fcd-921f-097eb31e974b response_code = 200 uri = /network-bootstore-config
18702025-01-17T14:38:37.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47090
18712025-01-17T14:38:37.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47090 req_id = 3ac7ed78-b5f4-4b31-8e80-16c9946662e4 response_code = 200 uri = /v2p
18722025-01-17T14:38:49.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6744 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 329ec692-d5e8-4959-9001-44fa8bcc264b response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
18732025-01-17T14:38:59.144ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49556
18742025-01-17T14:38:59.145ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49556 req_id = d7d61afa-9f01-4f20-bb4b-2186725a8b64 response_code = 200 uri = /baseboard
18752025-01-17T14:39:06.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37992
18762025-01-17T14:39:06.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37992 req_id = 3d455091-3b8a-43ae-b087-bfd018ff5ac2 response_code = 200 uri = /vpc-routes
18772025-01-17T14:39:06.526ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
18782025-01-17T14:39:06.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37992 req_id = c6438423-ef8d-4591-bd00-a3a64490c204 response_code = 204 uri = /eip-gateways
18792025-01-17T14:39:06.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37992 req_id = 314693bb-9633-415c-8bcb-5a39bab8fd0d response_code = 204 uri = /vpc-routes
18802025-01-17T14:39:06.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46860
18812025-01-17T14:39:06.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46860 req_id = f3b330fa-d8e8-4923-848c-59f5867cca90 response_code = 200 uri = /v2p
18822025-01-17T14:39:06.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51141
18832025-01-17T14:39:06.735ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18842025-01-17T14:39:06.771ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18852025-01-17T14:39:06.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51141 req_id = 288f2d2b-4bde-4b8e-91ac-7866064b9a08 response_code = 204 uri = /switch-ports
18862025-01-17T14:39:06.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51141 req_id = 4dce4d44-96c2-48f4-9d19-e7db72f71459 response_code = 200 uri = /network-bootstore-config
18872025-01-17T14:39:07.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39976
18882025-01-17T14:39:07.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39976 req_id = 31fb06b2-837b-4c3c-8c8e-c25155f9bcf0 response_code = 200 uri = /vpc-routes
18892025-01-17T14:39:07.156ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
18902025-01-17T14:39:07.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39976 req_id = 477f72c9-fd7a-4dda-9018-4b7a62f4c263 response_code = 204 uri = /eip-gateways
18912025-01-17T14:39:07.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63233
18922025-01-17T14:39:07.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63233 req_id = 36918f06-17cf-415b-ae17-9cd4725022d9 response_code = 200 uri = /v2p
18932025-01-17T14:39:07.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39976 req_id = e1f222a7-fd09-41d9-8fae-00895d99ab36 response_code = 204 uri = /vpc-routes
18942025-01-17T14:39:07.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47301
18952025-01-17T14:39:07.350ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18962025-01-17T14:39:07.388ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18972025-01-17T14:39:07.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91875 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47301 req_id = def82ace-0f41-47e5-bfe3-0e0158b53eec response_code = 204 uri = /switch-ports
18982025-01-17T14:39:07.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47301 req_id = c97acf7f-b5c8-4124-a552-0868024fc2b4 response_code = 200 uri = /network-bootstore-config
18992025-01-17T14:39:07.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33885
19002025-01-17T14:39:07.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33885 req_id = 11122542-e6fe-40a3-8ae7-afd65f96e938 response_code = 200 uri = /v2p
19012025-01-17T14:39:07.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51021
19022025-01-17T14:39:07.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51021 req_id = 0fe2d3d2-a249-46a3-af54-06443b3c98d6 response_code = 200 uri = /vpc-routes
19032025-01-17T14:39:07.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
19042025-01-17T14:39:07.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51021 req_id = 21e9853a-9562-4dc8-9e4a-896c293fa011 response_code = 204 uri = /eip-gateways
19052025-01-17T14:39:07.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51021 req_id = 51449709-157d-4831-abfc-66e134a493f1 response_code = 204 uri = /vpc-routes
19062025-01-17T14:39:07.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47919
19072025-01-17T14:39:07.640ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19082025-01-17T14:39:07.677ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19092025-01-17T14:39:07.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47919 req_id = 126a1bb9-c860-4915-9d20-5f9b8212a041 response_code = 204 uri = /switch-ports
19102025-01-17T14:39:07.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47919 req_id = 86bfe270-0e2b-4714-912f-db8a9c178761 response_code = 200 uri = /network-bootstore-config
19112025-01-17T14:39:19.822ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19122025-01-17T14:39:19.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7716 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = e3fe0e6c-9ce9-4c0e-b99d-977dbd8e7c76 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
19132025-01-17T14:39:29.179ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42227
19142025-01-17T14:39:29.179ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42227 req_id = ae9bc142-fe51-47af-a31d-758347f56340 response_code = 200 uri = /baseboard
19152025-01-17T14:39:36.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65382
19162025-01-17T14:39:36.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65382 req_id = 85ce5bf7-d800-4da6-a038-2f2d745695c9 response_code = 200 uri = /vpc-routes
19172025-01-17T14:39:36.393ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
19182025-01-17T14:39:36.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65382 req_id = 7a6e619c-c6a2-448b-8cd9-a502636859c8 response_code = 204 uri = /eip-gateways
19192025-01-17T14:39:36.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65382 req_id = 3e79569e-3e1e-4381-aa1a-c874c0ea5271 response_code = 204 uri = /vpc-routes
19202025-01-17T14:39:36.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59259
19212025-01-17T14:39:36.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19222025-01-17T14:39:36.459ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19232025-01-17T14:39:36.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87217 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59259 req_id = fd961dd3-989f-4f63-8fd1-9142a824ef76 response_code = 204 uri = /switch-ports
19242025-01-17T14:39:36.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42610
19252025-01-17T14:39:36.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42610 req_id = e71810d5-2b58-4923-bd9b-e48da6fafe91 response_code = 200 uri = /v2p
19262025-01-17T14:39:36.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59259 req_id = 6ce2d41d-58f4-4b16-9bb1-a19d4aa5cace response_code = 200 uri = /network-bootstore-config
19272025-01-17T14:39:36.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38669
19282025-01-17T14:39:36.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38669 req_id = 6881af93-d7d3-467e-9b80-5ea443a6a7b4 response_code = 200 uri = /vpc-routes
19292025-01-17T14:39:36.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
19302025-01-17T14:39:36.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38669 req_id = 1a91ed96-24eb-4573-94a0-46ae3b670361 response_code = 204 uri = /eip-gateways
19312025-01-17T14:39:36.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38669 req_id = afc6e7d3-4294-4da9-b68a-1c66b88fbe2d response_code = 204 uri = /vpc-routes
19322025-01-17T14:39:37.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64836
19332025-01-17T14:39:37.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64836 req_id = 320f1c14-7e5b-43a8-b1d9-6454a07b797c response_code = 200 uri = /v2p
19342025-01-17T14:39:37.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47789
19352025-01-17T14:39:37.108ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19362025-01-17T14:39:37.146ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19372025-01-17T14:39:37.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47789 req_id = d79eaac9-2ca9-464c-a49e-872e15d1b7cd response_code = 204 uri = /switch-ports
19382025-01-17T14:39:37.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47789 req_id = 62f9dbc6-d22b-46bb-bf20-772a79f90fb5 response_code = 200 uri = /network-bootstore-config
19392025-01-17T14:39:37.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34218
19402025-01-17T14:39:37.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34218 req_id = 36ee7f3b-18fb-462e-a8d9-ac3b1fbb264a response_code = 200 uri = /v2p
19412025-01-17T14:39:37.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55414
19422025-01-17T14:39:37.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55414 req_id = b9f82e19-00f8-471c-ad8f-321cf48dd119 response_code = 200 uri = /vpc-routes
19432025-01-17T14:39:37.409ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
19442025-01-17T14:39:37.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55414 req_id = 3070c86f-db60-4ef0-9e9f-3e7722feaf40 response_code = 204 uri = /eip-gateways
19452025-01-17T14:39:37.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55414 req_id = 6cb7b6a2-1b80-4b2a-a7b7-99f93fc31b8c response_code = 204 uri = /vpc-routes
19462025-01-17T14:39:37.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41743
19472025-01-17T14:39:37.452ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19482025-01-17T14:39:37.488ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19492025-01-17T14:39:37.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41743 req_id = 1f6a9d9e-6485-4b6e-8002-7a3d39a4b860 response_code = 204 uri = /switch-ports
19502025-01-17T14:39:37.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41743 req_id = 5bcb85d8-9ffe-4b4f-9496-f6044d2e1373 response_code = 200 uri = /network-bootstore-config
19512025-01-17T14:39:49.865ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8369 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = f0337836-6398-40e3-a568-4de557c04393 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
19522025-01-17T14:39:59.212ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41756
19532025-01-17T14:39:59.212ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41756 req_id = 8d388a97-9898-4e44-821e-7f23fc14b100 response_code = 200 uri = /baseboard
19542025-01-17T14:40:06.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38998
19552025-01-17T14:40:06.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38998 req_id = 9c86f6ae-071f-4021-9001-6de0c12f69ec response_code = 200 uri = /vpc-routes
19562025-01-17T14:40:06.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49793
19572025-01-17T14:40:06.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49793 req_id = 1f36ffbc-48dd-4c70-9eed-20e06a3e9401 response_code = 200 uri = /v2p
19582025-01-17T14:40:06.626ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
19592025-01-17T14:40:06.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38998 req_id = a52e7bd9-45c7-40ce-9ac1-b37af2b1e01a response_code = 204 uri = /eip-gateways
19602025-01-17T14:40:06.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38998 req_id = 2ff30b3c-d172-4ce1-b8be-61dec601c840 response_code = 204 uri = /vpc-routes
19612025-01-17T14:40:06.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45121
19622025-01-17T14:40:06.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19632025-01-17T14:40:06.734ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19642025-01-17T14:40:06.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107393 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45121 req_id = c75ded08-5362-48dd-9e30-294aae247b40 response_code = 204 uri = /switch-ports
19652025-01-17T14:40:06.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45121 req_id = b07907b6-8199-4a82-a592-bb1eb32c6368 response_code = 200 uri = /network-bootstore-config
19662025-01-17T14:40:07.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49194
19672025-01-17T14:40:07.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49194 req_id = f1310471-ffda-4838-b098-b04dc0dcad74 response_code = 200 uri = /vpc-routes
19682025-01-17T14:40:07.117ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
19692025-01-17T14:40:07.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49194 req_id = cfc1b760-7243-4d6d-8d53-9c9bbd644b44 response_code = 204 uri = /eip-gateways
19702025-01-17T14:40:07.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49194 req_id = c4f430d7-ff78-451d-9861-bcdbaa1169c0 response_code = 204 uri = /vpc-routes
19712025-01-17T14:40:07.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43604
19722025-01-17T14:40:07.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43604 req_id = 2f560ef8-6a6b-4aed-80ee-6f307c86a2f4 response_code = 200 uri = /v2p
19732025-01-17T14:40:07.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45381
19742025-01-17T14:40:07.304ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19752025-01-17T14:40:07.347ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19762025-01-17T14:40:07.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95233 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45381 req_id = ac995176-c580-46bb-8184-6dcae3355d60 response_code = 204 uri = /switch-ports
19772025-01-17T14:40:07.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45381 req_id = b1dd8c1a-8c56-4f85-b976-d831179a0ef8 response_code = 200 uri = /network-bootstore-config
19782025-01-17T14:40:07.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49524
19792025-01-17T14:40:07.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49524 req_id = e495a125-9365-4b45-b639-6630890f41d2 response_code = 200 uri = /vpc-routes
19802025-01-17T14:40:07.537ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
19812025-01-17T14:40:07.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49524 req_id = 3e83ec4c-cca0-4b28-8f57-56e8ebd10104 response_code = 204 uri = /eip-gateways
19822025-01-17T14:40:07.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49524 req_id = b04d9d0b-0986-42c1-b723-0aabae92f366 response_code = 204 uri = /vpc-routes
19832025-01-17T14:40:07.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61210
19842025-01-17T14:40:07.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19852025-01-17T14:40:07.664ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19862025-01-17T14:40:07.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61210 req_id = 07ef321e-a3d7-4ebc-a44a-d7303e6ce07e response_code = 204 uri = /switch-ports
19872025-01-17T14:40:07.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65237
19882025-01-17T14:40:07.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65237 req_id = 9f6ef788-0dac-4667-87f1-db871f72f117 response_code = 200 uri = /v2p
19892025-01-17T14:40:07.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61210 req_id = 4d28bf24-0298-44f3-8c83-1e8b7ac25a18 response_code = 200 uri = /network-bootstore-config
19902025-01-17T14:40:19.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5789 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = fd1f6810-a52c-405a-92cc-814394495972 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
19912025-01-17T14:40:29.249ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51423
19922025-01-17T14:40:29.249ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51423 req_id = 7b3175a6-c678-49c4-9806-066f2709cc53 response_code = 200 uri = /baseboard
19932025-01-17T14:40:36.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40273
19942025-01-17T14:40:36.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40273 req_id = 0379fe73-b75c-4d5d-a1a8-cd7596e00faf response_code = 200 uri = /vpc-routes
19952025-01-17T14:40:36.378ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
19962025-01-17T14:40:36.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40273 req_id = 6bdfd45a-c4c3-46cc-a307-6603c1b9fc33 response_code = 204 uri = /eip-gateways
19972025-01-17T14:40:36.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40273 req_id = 88013418-cbc4-43c3-aa52-be032aa1a824 response_code = 204 uri = /vpc-routes
19982025-01-17T14:40:36.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33689
19992025-01-17T14:40:36.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20002025-01-17T14:40:36.521ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20012025-01-17T14:40:36.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91707 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33689 req_id = 6e9f8fba-2152-45ad-b621-9c3e634ab1a4 response_code = 204 uri = /switch-ports
20022025-01-17T14:40:36.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42141
20032025-01-17T14:40:36.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33689 req_id = a71749f4-6fdc-4a11-b275-e16b3574a471 response_code = 200 uri = /network-bootstore-config
20042025-01-17T14:40:36.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42141 req_id = 40c89831-e24c-4461-b076-274abac9bd0c response_code = 200 uri = /v2p
20052025-01-17T14:40:36.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32771
20062025-01-17T14:40:36.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32771 req_id = 9771d3db-5a3d-4159-82ac-bee70d846137 response_code = 200 uri = /vpc-routes
20072025-01-17T14:40:37.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
20082025-01-17T14:40:37.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32771 req_id = 3fe9276a-d244-44e8-a470-c6850dbf5b68 response_code = 204 uri = /eip-gateways
20092025-01-17T14:40:37.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32771 req_id = a16cd4d4-7b9f-4e90-803e-176d4b9e316d response_code = 204 uri = /vpc-routes
20102025-01-17T14:40:37.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34848
20112025-01-17T14:40:37.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34848 req_id = cd11f375-20bc-4d07-92d9-7d448dc642ec response_code = 200 uri = /v2p
20122025-01-17T14:40:37.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62200
20132025-01-17T14:40:37.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20142025-01-17T14:40:37.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20152025-01-17T14:40:37.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62200 req_id = 13c374a5-fae0-40a5-b61f-fd7a0d71257b response_code = 204 uri = /switch-ports
20162025-01-17T14:40:37.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62200 req_id = 3d03c393-80d2-4afb-8b3e-b2b012ca8e95 response_code = 200 uri = /network-bootstore-config
20172025-01-17T14:40:37.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62279
20182025-01-17T14:40:37.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62279 req_id = 2d2a0245-7e85-4b24-9e40-ed03b1029682 response_code = 200 uri = /vpc-routes
20192025-01-17T14:40:37.360ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
20202025-01-17T14:40:37.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62279 req_id = eca06635-b5ec-4538-a952-7c3ab8a3b4f5 response_code = 204 uri = /eip-gateways
20212025-01-17T14:40:37.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62279 req_id = 86a8f972-de50-421b-b7bc-91b15a081fa0 response_code = 204 uri = /vpc-routes
20222025-01-17T14:40:37.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64577
20232025-01-17T14:40:37.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64577 req_id = e71e82e2-af04-42e9-8e2b-0bb9743aaf39 response_code = 200 uri = /v2p
20242025-01-17T14:40:37.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51886
20252025-01-17T14:40:37.465ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20262025-01-17T14:40:37.501ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20272025-01-17T14:40:37.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84580 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51886 req_id = 5e8c1590-43e9-47d4-ba5b-88e42233acc5 response_code = 204 uri = /switch-ports
20282025-01-17T14:40:37.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51886 req_id = 288edf81-8ad9-458f-9a37-6ac7cfec10c3 response_code = 200 uri = /network-bootstore-config
20292025-01-17T14:40:49.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6894 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = e0100ec8-a001-4f30-9015-e5087c32283f response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
20302025-01-17T14:40:59.281ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64322
20312025-01-17T14:40:59.282ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64322 req_id = e2a27037-1f8c-4f13-b13f-0dfd84b71173 response_code = 200 uri = /baseboard
20322025-01-17T14:41:06.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38877
20332025-01-17T14:41:06.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38877 req_id = f81bc038-92de-4220-a5ef-6d41e03f8316 response_code = 200 uri = /vpc-routes
20342025-01-17T14:41:06.614ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
20352025-01-17T14:41:06.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38877 req_id = a942d58f-461a-45c8-aeeb-9711ca815b23 response_code = 204 uri = /eip-gateways
20362025-01-17T14:41:06.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38877 req_id = 11c836f4-c136-4032-ab0d-cf9f13466d55 response_code = 204 uri = /vpc-routes
20372025-01-17T14:41:06.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59187
20382025-01-17T14:41:06.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59187 req_id = a5b4320a-d674-4e4e-9b89-27208a273ccf response_code = 200 uri = /v2p
20392025-01-17T14:41:06.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63102
20402025-01-17T14:41:06.912ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20412025-01-17T14:41:06.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20422025-01-17T14:41:07.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63102 req_id = df7e4035-7731-48a2-b68a-aafe1666affa response_code = 204 uri = /switch-ports
20432025-01-17T14:41:07.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50231
20442025-01-17T14:41:07.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63102 req_id = 68fbdae0-edfc-4edd-903c-6da34111f990 response_code = 200 uri = /network-bootstore-config
20452025-01-17T14:41:07.011ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20462025-01-17T14:41:07.011ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20472025-01-17T14:41:07.011ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20482025-01-17T14:41:07.011ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20492025-01-17T14:41:07.011ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20502025-01-17T14:41:07.011ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20512025-01-17T14:41:07.011ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20522025-01-17T14:41:07.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 484 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50231 req_id = 77e6729c-aba7-42d4-8302-784654ad35c5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20532025-01-17T14:41:07.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42734
20542025-01-17T14:41:07.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42734 req_id = f1d4b70e-3a12-47fd-9646-e95798672325 response_code = 200 uri = /vpc-routes
20552025-01-17T14:41:07.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
20562025-01-17T14:41:07.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42734 req_id = 2100f9c7-c54d-4924-8815-23ba5bce7463 response_code = 204 uri = /eip-gateways
20572025-01-17T14:41:07.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42734 req_id = 948a27f6-5a89-4493-87a5-295b427fa30a response_code = 204 uri = /vpc-routes
20582025-01-17T14:41:07.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41389
20592025-01-17T14:41:07.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41389 req_id = 1c093182-694f-4e39-b677-68f27801839f response_code = 200 uri = /v2p
20602025-01-17T14:41:07.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61652
20612025-01-17T14:41:07.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20622025-01-17T14:41:07.385ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20632025-01-17T14:41:07.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61652 req_id = 5c03e4f0-51fe-4b94-a4c1-68719e1ce6fb response_code = 204 uri = /switch-ports
20642025-01-17T14:41:07.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63434
20652025-01-17T14:41:07.438ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20662025-01-17T14:41:07.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61652 req_id = ad3c556f-3777-43ba-8e23-1f8d5f0a7595 response_code = 200 uri = /network-bootstore-config
20672025-01-17T14:41:07.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20682025-01-17T14:41:07.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20692025-01-17T14:41:07.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20702025-01-17T14:41:07.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20712025-01-17T14:41:07.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20722025-01-17T14:41:07.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20732025-01-17T14:41:07.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 532 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63434 req_id = df5d1c34-b30a-4327-96b5-70604ae70597 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20742025-01-17T14:41:07.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36913
20752025-01-17T14:41:07.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36913 req_id = 356ffa38-a256-4a32-bac8-1152fc98935a response_code = 200 uri = /vpc-routes
20762025-01-17T14:41:07.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
20772025-01-17T14:41:07.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36913 req_id = d24e5cf6-3531-43d7-b66b-f17eb36f8f97 response_code = 204 uri = /eip-gateways
20782025-01-17T14:41:07.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33865
20792025-01-17T14:41:07.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33865 req_id = 1aa13423-5ba2-4590-ad38-443dfa8ad189 response_code = 200 uri = /v2p
20802025-01-17T14:41:07.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36913 req_id = 6134f0e9-f4b5-4534-a4e4-35d597beb15b response_code = 204 uri = /vpc-routes
20812025-01-17T14:41:08.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60386
20822025-01-17T14:41:08.072ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20832025-01-17T14:41:08.072ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20842025-01-17T14:41:08.072ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20852025-01-17T14:41:08.072ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20862025-01-17T14:41:08.072ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20872025-01-17T14:41:08.072ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20882025-01-17T14:41:08.072ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20892025-01-17T14:41:08.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60386 req_id = 3a298845-75fe-4872-a46b-f0e9adeb577c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20902025-01-17T14:41:08.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41598
20912025-01-17T14:41:08.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20922025-01-17T14:41:08.127ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20932025-01-17T14:41:08.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41598 req_id = 10daedf1-2ebb-4fbb-80e0-cc2de61443d0 response_code = 204 uri = /switch-ports
20942025-01-17T14:41:08.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41598 req_id = 82524823-3d6b-42e1-ba38-6425d1e6929a response_code = 200 uri = /network-bootstore-config
20952025-01-17T14:41:19.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7337 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 7c6de8bd-d8e4-46cc-8b6b-06879f7f912a response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
20962025-01-17T14:41:29.315ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33460
20972025-01-17T14:41:29.315ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33460 req_id = 77eb604f-d616-4749-aae2-331f6e0aa385 response_code = 200 uri = /baseboard
20982025-01-17T14:41:36.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52847
20992025-01-17T14:41:36.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52847 req_id = 233e5f84-f003-4c8e-9f6a-ff9e0c3d26af response_code = 200 uri = /vpc-routes
21002025-01-17T14:41:36.428ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
21012025-01-17T14:41:36.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52847 req_id = 2b7dd844-c1d8-47d1-9281-7c83db23e5fe response_code = 204 uri = /eip-gateways
21022025-01-17T14:41:36.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52847 req_id = 68624283-02c6-4dcd-acfa-87750437b9ce response_code = 204 uri = /vpc-routes
21032025-01-17T14:41:36.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40909
21042025-01-17T14:41:36.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40909 req_id = b3044387-1953-4ccd-8a0a-f5b0198c7a1e response_code = 200 uri = /v2p
21052025-01-17T14:41:36.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56947
21062025-01-17T14:41:36.580ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21072025-01-17T14:41:36.615ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21082025-01-17T14:41:36.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56947 req_id = 7af3b188-36b9-44e9-8edf-f8bc122d0df3 response_code = 204 uri = /switch-ports
21092025-01-17T14:41:36.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56947 req_id = fc378d0c-6db1-401c-b330-b4691afb37ea response_code = 200 uri = /network-bootstore-config
21102025-01-17T14:41:36.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63738
21112025-01-17T14:41:36.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63738 req_id = 383a9670-9c48-4d1b-bd46-a96efbaa8db8 response_code = 200 uri = /vpc-routes
21122025-01-17T14:41:36.974ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
21132025-01-17T14:41:36.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63738 req_id = 1ef825be-c04b-435c-a85c-76338dc95e2d response_code = 204 uri = /eip-gateways
21142025-01-17T14:41:37.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62357
21152025-01-17T14:41:37.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62357 req_id = 806faf71-6bd1-4afe-91b9-d462c2bf6b51 response_code = 200 uri = /v2p
21162025-01-17T14:41:37.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63738 req_id = e7e303f7-a502-4207-ae75-557cfccad745 response_code = 204 uri = /vpc-routes
21172025-01-17T14:41:37.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37368
21182025-01-17T14:41:37.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21192025-01-17T14:41:37.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21202025-01-17T14:41:37.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115890 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37368 req_id = 0d132b96-4853-4f9e-bf82-b66abbcbab23 response_code = 204 uri = /switch-ports
21212025-01-17T14:41:37.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37368 req_id = 15cb9964-3a37-4a04-b1cc-e03b82a43b28 response_code = 200 uri = /network-bootstore-config
21222025-01-17T14:41:37.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38522
21232025-01-17T14:41:37.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38522 req_id = d2f10782-7007-4901-b475-afb2371f8d8d response_code = 200 uri = /vpc-routes
21242025-01-17T14:41:37.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
21252025-01-17T14:41:37.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38522 req_id = 34faad9d-5c7c-4272-a5fe-44e6d39ea381 response_code = 204 uri = /eip-gateways
21262025-01-17T14:41:37.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38522 req_id = 21a9fc6e-ad3c-4d08-94d3-52ed4a36aaca response_code = 204 uri = /vpc-routes
21272025-01-17T14:41:37.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42138
21282025-01-17T14:41:37.507ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21292025-01-17T14:41:37.546ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21302025-01-17T14:41:37.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42138 req_id = c3d5b3ea-22fa-4683-a558-e38db79cfcd8 response_code = 204 uri = /switch-ports
21312025-01-17T14:41:37.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37383
21322025-01-17T14:41:37.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37383 req_id = 1d490a61-1016-4887-87cd-147dcc378e4c response_code = 200 uri = /v2p
21332025-01-17T14:41:37.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42138 req_id = 9234925b-b456-43e1-977b-2fb8ad45838e response_code = 200 uri = /network-bootstore-config
21342025-01-17T14:41:49.862ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6308 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 80972e36-9544-4248-992e-5f7d8cee2e65 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
21352025-01-17T14:41:59.349ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63810
21362025-01-17T14:41:59.349ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63810 req_id = ec5fdec3-b95e-4411-a43e-732096f51b0f response_code = 200 uri = /baseboard
21372025-01-17T14:42:06.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50930
21382025-01-17T14:42:06.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50930 req_id = 91ab9536-b863-454a-9557-6c021fe4ceab response_code = 200 uri = /vpc-routes
21392025-01-17T14:42:06.488ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
21402025-01-17T14:42:06.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50930 req_id = cf35772d-ac80-425a-b29b-02636ded9101 response_code = 204 uri = /eip-gateways
21412025-01-17T14:42:06.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50930 req_id = e094358c-1e65-46b8-a76e-1efa18d8c9d8 response_code = 204 uri = /vpc-routes
21422025-01-17T14:42:06.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45301
21432025-01-17T14:42:06.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45301 req_id = a083c933-224d-4276-8285-5156a5991cd7 response_code = 200 uri = /v2p
21442025-01-17T14:42:06.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61931
21452025-01-17T14:42:06.851ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21462025-01-17T14:42:06.897ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21472025-01-17T14:42:06.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61931 req_id = 2e4fcee7-6298-48da-9eda-9555d0e32803 response_code = 204 uri = /switch-ports
21482025-01-17T14:42:06.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61931 req_id = ccbf95ec-03fb-4897-b4ec-ee29c4ce0fd6 response_code = 200 uri = /network-bootstore-config
21492025-01-17T14:42:07.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59199
21502025-01-17T14:42:07.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59199 req_id = 133f3d87-3d5e-423b-9fad-7768eb4e39f2 response_code = 200 uri = /v2p
21512025-01-17T14:42:07.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54372
21522025-01-17T14:42:07.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54372 req_id = 933f7426-c4f3-4c4f-8c07-cdb5a56416c6 response_code = 200 uri = /vpc-routes
21532025-01-17T14:42:07.183ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
21542025-01-17T14:42:07.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54372 req_id = ce1d3147-1383-4e38-b85c-cc78097b4115 response_code = 204 uri = /eip-gateways
21552025-01-17T14:42:07.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54372 req_id = 707a7233-2be5-4065-a9d8-abb1ccea50fe response_code = 204 uri = /vpc-routes
21562025-01-17T14:42:07.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41508
21572025-01-17T14:42:07.341ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21582025-01-17T14:42:07.379ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21592025-01-17T14:42:07.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41508 req_id = ac50f2bf-d47c-4e64-80cf-ed86b62c08e3 response_code = 204 uri = /switch-ports
21602025-01-17T14:42:07.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41508 req_id = a1d646b2-b01a-4952-9ba1-7aee2881c82c response_code = 200 uri = /network-bootstore-config
21612025-01-17T14:42:07.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62814
21622025-01-17T14:42:07.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62814 req_id = c912d17b-a26e-44cc-b0d2-5fa989a89f57 response_code = 200 uri = /vpc-routes
21632025-01-17T14:42:07.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60663
21642025-01-17T14:42:07.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60663 req_id = 812a0015-81bc-4162-a4ed-2dcc04fa7dcf response_code = 200 uri = /v2p
21652025-01-17T14:42:07.643ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
21662025-01-17T14:42:07.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62814 req_id = 3dfc8330-17fa-4378-956a-6c5154244223 response_code = 204 uri = /eip-gateways
21672025-01-17T14:42:07.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62814 req_id = 0530cca6-4078-4bee-9b24-6e62cfb5e039 response_code = 204 uri = /vpc-routes
21682025-01-17T14:42:07.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36615
21692025-01-17T14:42:07.703ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21702025-01-17T14:42:07.739ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21712025-01-17T14:42:07.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86713 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36615 req_id = 39ccea1d-7875-4157-85a4-fe306d33179e response_code = 204 uri = /switch-ports
21722025-01-17T14:42:07.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36615 req_id = 34af6726-05f1-42a7-a07b-53a023bdee77 response_code = 200 uri = /network-bootstore-config
21732025-01-17T14:42:19.865ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8424 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 7f8211f1-58ba-40eb-8390-370add5fe4f3 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
21742025-01-17T14:42:29.382ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57339
21752025-01-17T14:42:29.382ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57339 req_id = b35902df-7ca2-464b-b982-8950901c1d40 response_code = 200 uri = /baseboard
21762025-01-17T14:42:36.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33296
21772025-01-17T14:42:36.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33296 req_id = ffbedb31-973a-4340-95e7-ff42f640d45e response_code = 200 uri = /vpc-routes
21782025-01-17T14:42:36.426ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
21792025-01-17T14:42:36.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33296 req_id = 8178da1b-329b-490d-834d-d8efd91b0c53 response_code = 204 uri = /eip-gateways
21802025-01-17T14:42:36.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33296 req_id = cd3d8ec3-2ec6-4b4b-b8e1-7d6eb9387ea7 response_code = 204 uri = /vpc-routes
21812025-01-17T14:42:36.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63885
21822025-01-17T14:42:36.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63885 req_id = ac66de73-96b1-43db-b9b9-4a63d41d815f response_code = 200 uri = /v2p
21832025-01-17T14:42:36.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56582
21842025-01-17T14:42:36.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21852025-01-17T14:42:36.545ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21862025-01-17T14:42:36.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92984 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56582 req_id = 5bf666b0-9df3-427c-b307-8eff9c8cadf4 response_code = 204 uri = /switch-ports
21872025-01-17T14:42:36.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56582 req_id = adad1e14-bd81-48ee-b3d1-096328d95ce1 response_code = 200 uri = /network-bootstore-config
21882025-01-17T14:42:37.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64020
21892025-01-17T14:42:37.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64020 req_id = 0cd024e0-1805-4fd1-9c0c-674340906568 response_code = 200 uri = /vpc-routes
21902025-01-17T14:42:37.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
21912025-01-17T14:42:37.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64020 req_id = 09f521cd-4bab-4507-b0c2-4698af6be00e response_code = 204 uri = /eip-gateways
21922025-01-17T14:42:37.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64020 req_id = b7db5e9a-d3a6-48ee-bf11-73100b5007fe response_code = 204 uri = /vpc-routes
21932025-01-17T14:42:37.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55142
21942025-01-17T14:42:37.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21952025-01-17T14:42:37.295ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21962025-01-17T14:42:37.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55142 req_id = 227b65dc-5e75-477c-905d-913e09fcc6fa response_code = 204 uri = /switch-ports
21972025-01-17T14:42:37.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34521
21982025-01-17T14:42:37.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34389
21992025-01-17T14:42:37.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55142 req_id = c36400df-0610-46b6-8137-2cbc1a08cce2 response_code = 200 uri = /network-bootstore-config
22002025-01-17T14:42:37.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34389 req_id = a40b136e-b265-47ff-ad5d-b94cb713bfa8 response_code = 200 uri = /vpc-routes
22012025-01-17T14:42:37.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34521 req_id = 6ecada38-e88a-4bd9-b854-671f63b9a534 response_code = 200 uri = /v2p
22022025-01-17T14:42:37.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
22032025-01-17T14:42:37.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34389 req_id = f4f9e1fe-a769-43cc-9a9e-79b861cb4efe response_code = 204 uri = /eip-gateways
22042025-01-17T14:42:37.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34389 req_id = 18b4c61c-e537-435e-a4e8-046ea43abd3b response_code = 204 uri = /vpc-routes
22052025-01-17T14:42:37.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52257
22062025-01-17T14:42:37.433ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22072025-01-17T14:42:37.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22082025-01-17T14:42:37.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98336 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52257 req_id = 1f46a8d5-5910-465e-80e9-37b2ba613303 response_code = 204 uri = /switch-ports
22092025-01-17T14:42:37.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42838
22102025-01-17T14:42:37.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42838 req_id = 172b23cb-fdb3-4975-8ff0-e162df26a5c6 response_code = 200 uri = /v2p
22112025-01-17T14:42:37.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52257 req_id = 1e3bcad8-c981-4af2-b27f-1164a5c12020 response_code = 200 uri = /network-bootstore-config
22122025-01-17T14:42:49.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7861 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = b4153bfb-270e-4043-84b5-b2410839eefb response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
22132025-01-17T14:42:59.415ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34916
22142025-01-17T14:42:59.415ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34916 req_id = ca70c204-a59a-4c6b-ad9e-f547523b18ad response_code = 200 uri = /baseboard
22152025-01-17T14:43:06.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45442
22162025-01-17T14:43:06.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45442 req_id = a8fe2f66-b93e-4607-a038-bd81153a2a83 response_code = 200 uri = /vpc-routes
22172025-01-17T14:43:06.618ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
22182025-01-17T14:43:06.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45442 req_id = b22b189c-d7b6-4130-8780-b2081e64203f response_code = 204 uri = /eip-gateways
22192025-01-17T14:43:06.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45442 req_id = 9c67dab6-3dc1-4e75-929d-f594fb9564ac response_code = 204 uri = /vpc-routes
22202025-01-17T14:43:06.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60028
22212025-01-17T14:43:06.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60028 req_id = bea13e03-c24d-47cd-b8bf-80a83b008b48 response_code = 200 uri = /v2p
22222025-01-17T14:43:06.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50845
22232025-01-17T14:43:06.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22242025-01-17T14:43:06.804ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22252025-01-17T14:43:06.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50845 req_id = 1c3d897a-8c9d-4036-8864-8ae7f124a4e3 response_code = 204 uri = /switch-ports
22262025-01-17T14:43:06.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50845 req_id = 42a64747-f0bc-46a1-9255-18c8d2ebcb7a response_code = 200 uri = /network-bootstore-config
22272025-01-17T14:43:07.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45894
22282025-01-17T14:43:07.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45894 req_id = e85a6ff5-5227-43e6-ab08-89fa3a28ba10 response_code = 200 uri = /vpc-routes
22292025-01-17T14:43:07.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
22302025-01-17T14:43:07.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45894 req_id = 2047e4bf-98a5-41dc-81fa-7552fb18683f response_code = 204 uri = /eip-gateways
22312025-01-17T14:43:07.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45894 req_id = cf7e91b6-4cc5-46fb-b27d-5d69e7c412aa response_code = 204 uri = /vpc-routes
22322025-01-17T14:43:07.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63604
22332025-01-17T14:43:07.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63604 req_id = 20ebd8ba-891f-4393-84fb-75641bcb36ff response_code = 200 uri = /vpc-routes
22342025-01-17T14:43:07.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57119
22352025-01-17T14:43:07.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57119 req_id = 3ee95b07-f533-4f6e-adfe-b7482ce1de89 response_code = 200 uri = /v2p
22362025-01-17T14:43:07.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
22372025-01-17T14:43:07.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63604 req_id = 10fd4e81-54d0-4ca1-90c9-491a5155a4c7 response_code = 204 uri = /eip-gateways
22382025-01-17T14:43:07.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63604 req_id = d2e78f53-8d19-4acd-816c-b276e8c3bdd7 response_code = 204 uri = /vpc-routes
22392025-01-17T14:43:07.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61130
22402025-01-17T14:43:07.502ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22412025-01-17T14:43:07.540ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22422025-01-17T14:43:07.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96249 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61130 req_id = a0971ab7-a5b7-43d0-a5fb-612ebceb18b9 response_code = 204 uri = /switch-ports
22432025-01-17T14:43:07.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59640
22442025-01-17T14:43:07.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33796
22452025-01-17T14:43:07.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33796 req_id = 54f5542c-bd5f-4a60-a6ce-3f8a4b9771ab response_code = 200 uri = /v2p
22462025-01-17T14:43:07.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61130 req_id = b4e1938e-9299-427e-a349-ad35de11e7ca response_code = 200 uri = /network-bootstore-config
22472025-01-17T14:43:07.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22482025-01-17T14:43:07.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22492025-01-17T14:43:07.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91631 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59640 req_id = 11492d31-88ad-461a-a8c3-bd892cff8e3e response_code = 204 uri = /switch-ports
22502025-01-17T14:43:07.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59640 req_id = 7b1c2b19-8b8d-4373-9873-6e9fee895423 response_code = 200 uri = /network-bootstore-config
22512025-01-17T14:43:19.862ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6024 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 3e710aa4-cfa6-4554-961d-ea6410887712 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
22522025-01-17T14:43:29.449ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60420
22532025-01-17T14:43:29.449ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60420 req_id = dad49b4a-fb16-4fa8-890d-2fd1b6be8258 response_code = 200 uri = /baseboard
22542025-01-17T14:43:36.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53597
22552025-01-17T14:43:36.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53597 req_id = 0321d40d-10e4-4add-88f5-ff20274b0394 response_code = 200 uri = /vpc-routes
22562025-01-17T14:43:36.418ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
22572025-01-17T14:43:36.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53597 req_id = b505b603-2887-42ce-b538-c29caf60ee61 response_code = 204 uri = /eip-gateways
22582025-01-17T14:43:36.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54909
22592025-01-17T14:43:36.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54909 req_id = 3522c66a-26cc-42ae-bd08-b75cd4173f9b response_code = 200 uri = /v2p
22602025-01-17T14:43:36.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53597 req_id = dd6cedde-d625-491b-baac-9eb9787f0dcb response_code = 204 uri = /vpc-routes
22612025-01-17T14:43:36.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45430
22622025-01-17T14:43:36.597ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22632025-01-17T14:43:36.632ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22642025-01-17T14:43:36.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45430 req_id = e7e9725c-c607-497e-9149-fbf79f8768c6 response_code = 204 uri = /switch-ports
22652025-01-17T14:43:36.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45430 req_id = 0961997c-e72e-4f99-a00b-8636e739f852 response_code = 200 uri = /network-bootstore-config
22662025-01-17T14:43:36.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57376
22672025-01-17T14:43:36.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57376 req_id = dbce6ea9-c544-4906-ae5b-faf39fbcaecd response_code = 200 uri = /vpc-routes
22682025-01-17T14:43:36.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
22692025-01-17T14:43:36.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57376 req_id = 9bfabfcf-b039-4b31-be18-5032c20410f1 response_code = 204 uri = /eip-gateways
22702025-01-17T14:43:36.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57376 req_id = 5b65f731-b1ee-4378-b30f-397a9505234f response_code = 204 uri = /vpc-routes
22712025-01-17T14:43:37.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63840
22722025-01-17T14:43:37.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63840 req_id = 79e0b765-9314-487d-b613-e4464ed99c3a response_code = 200 uri = /v2p
22732025-01-17T14:43:37.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64649
22742025-01-17T14:43:37.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22752025-01-17T14:43:37.157ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22762025-01-17T14:43:37.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123672 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64649 req_id = 50ccf4f4-ebfa-4b9f-811f-6ebe8e6b80a1 response_code = 204 uri = /switch-ports
22772025-01-17T14:43:37.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64649 req_id = 63c69e1e-e81a-46a8-968d-982ee7abc95c response_code = 200 uri = /network-bootstore-config
22782025-01-17T14:43:37.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46752
22792025-01-17T14:43:37.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46752 req_id = e4104314-c214-47bd-b80c-b55d56d15d3d response_code = 200 uri = /vpc-routes
22802025-01-17T14:43:37.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38174
22812025-01-17T14:43:37.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38174 req_id = efbdd8ac-cae1-43c4-8209-f7f3b5fb45a0 response_code = 200 uri = /v2p
22822025-01-17T14:43:37.460ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
22832025-01-17T14:43:37.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46752 req_id = abb430e6-ccd2-4bb4-9c6d-c0e45ac8c1b6 response_code = 204 uri = /eip-gateways
22842025-01-17T14:43:37.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46752 req_id = 9f9fe8fa-5b11-403f-89dc-babe142521c7 response_code = 204 uri = /vpc-routes
22852025-01-17T14:43:37.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36988
22862025-01-17T14:43:37.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22872025-01-17T14:43:37.568ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22882025-01-17T14:43:37.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94350 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36988 req_id = a6822bde-3c5f-47b0-9f2c-282fbaa7f5d9 response_code = 204 uri = /switch-ports
22892025-01-17T14:43:37.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36988 req_id = 9dfb8a56-3f13-444f-9d2f-c3fbe3c7de8b response_code = 200 uri = /network-bootstore-config
22902025-01-17T14:43:49.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6573 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 899a7614-8fbe-4e8a-bcb9-db5087cee229 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
22912025-01-17T14:43:59.482ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54171
22922025-01-17T14:43:59.482ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54171 req_id = 6f18b04a-d386-441b-beb9-99a80477deed response_code = 200 uri = /baseboard
22932025-01-17T14:44:05.870ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22942025-01-17T14:44:05.870ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22952025-01-17T14:44:05.895ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 12160, tv_nsec: 120508252 } time_to_next_cleanup = 599.99999606s
22962025-01-17T14:44:06.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48370
22972025-01-17T14:44:06.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48370 req_id = 175feb3b-e3bc-47b6-88f8-9a7000be5fc1 response_code = 200 uri = /vpc-routes
22982025-01-17T14:44:06.506ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
22992025-01-17T14:44:06.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48370 req_id = 39fdd89e-3de4-410b-8ed7-6e728def8a9d response_code = 204 uri = /eip-gateways
23002025-01-17T14:44:06.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48370 req_id = 5b84d205-0344-4c4e-b031-d44b04ae5b88 response_code = 204 uri = /vpc-routes
23012025-01-17T14:44:06.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58109
23022025-01-17T14:44:06.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58109 req_id = 1279b733-22ab-4913-b94c-87d580f91ba1 response_code = 200 uri = /v2p
23032025-01-17T14:44:06.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37919
23042025-01-17T14:44:06.667ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23052025-01-17T14:44:06.703ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23062025-01-17T14:44:06.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89598 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37919 req_id = b2c515b8-1455-4c19-80e4-3fa143668b60 response_code = 204 uri = /switch-ports
23072025-01-17T14:44:06.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37919 req_id = fe1a7195-d3b0-4948-a177-510a12025233 response_code = 200 uri = /network-bootstore-config
23082025-01-17T14:44:07.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58558
23092025-01-17T14:44:07.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58558 req_id = 82d4726d-2c61-4778-a33b-e5a6131d87b4 response_code = 200 uri = /vpc-routes
23102025-01-17T14:44:07.097ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
23112025-01-17T14:44:07.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58558 req_id = e9035706-086d-4570-8403-b145051d50ef response_code = 204 uri = /eip-gateways
23122025-01-17T14:44:07.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65183
23132025-01-17T14:44:07.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65183 req_id = 7909169a-8fa4-432b-a7b0-0bdc6a0b4fcf response_code = 200 uri = /v2p
23142025-01-17T14:44:07.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58558 req_id = 9c0447df-47d9-4b52-9220-2e530d43072c response_code = 204 uri = /vpc-routes
23152025-01-17T14:44:07.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49936
23162025-01-17T14:44:07.234ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23172025-01-17T14:44:07.282ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23182025-01-17T14:44:07.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119028 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49936 req_id = de0ebad3-ce38-4f53-8110-23fe5c6e569e response_code = 204 uri = /switch-ports
23192025-01-17T14:44:07.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49936 req_id = 69eb347b-08cb-4928-b4d1-fa79d6ae194c response_code = 200 uri = /network-bootstore-config
23202025-01-17T14:44:07.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33383
23212025-01-17T14:44:07.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33383 req_id = 8261d75d-a07d-40f2-851f-eca65a9b10f8 response_code = 200 uri = /vpc-routes
23222025-01-17T14:44:07.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47223
23232025-01-17T14:44:07.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47223 req_id = d5dc4e21-aca7-4076-a96f-513be755a94d response_code = 200 uri = /v2p
23242025-01-17T14:44:07.574ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
23252025-01-17T14:44:07.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33383 req_id = ca2788ce-168a-4b63-a31e-8b6ff85c227e response_code = 204 uri = /eip-gateways
23262025-01-17T14:44:07.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33383 req_id = 5c0eed10-ade1-4afe-b39c-0e813bb93f74 response_code = 204 uri = /vpc-routes
23272025-01-17T14:44:07.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49636
23282025-01-17T14:44:07.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23292025-01-17T14:44:07.835ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23302025-01-17T14:44:07.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93505 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49636 req_id = 80b1a117-cf8e-41c5-9175-0f842f71dea7 response_code = 204 uri = /switch-ports
23312025-01-17T14:44:07.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49636 req_id = c0daf9f8-67a1-4310-a870-0a003546ce45 response_code = 200 uri = /network-bootstore-config
23322025-01-17T14:44:19.824ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23332025-01-17T14:44:19.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7194 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = d1bb2bc8-c09b-45eb-bfc7-5114bf77de87 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
23342025-01-17T14:44:29.517ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42477
23352025-01-17T14:44:29.517ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42477 req_id = b3399b08-196a-4b0e-89de-1610f0b201df response_code = 200 uri = /baseboard
23362025-01-17T14:44:36.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58881
23372025-01-17T14:44:36.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58881 req_id = 06b108e7-c953-4116-b0ab-48f8c90a66e5 response_code = 200 uri = /vpc-routes
23382025-01-17T14:44:36.367ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
23392025-01-17T14:44:36.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58881 req_id = 4481b0cb-fd97-48af-badd-61dff1d44a6b response_code = 204 uri = /eip-gateways
23402025-01-17T14:44:36.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58881 req_id = 47b84840-2480-4eb8-8f1c-d812c643c1df response_code = 204 uri = /vpc-routes
23412025-01-17T14:44:36.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42900
23422025-01-17T14:44:36.440ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23432025-01-17T14:44:36.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23442025-01-17T14:44:36.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42900 req_id = 86abf10c-7219-490f-8e7e-641fc571695f response_code = 204 uri = /switch-ports
23452025-01-17T14:44:36.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42900 req_id = 13222a8c-62ea-405c-98bd-53acaa7e6175 response_code = 200 uri = /network-bootstore-config
23462025-01-17T14:44:36.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51935
23472025-01-17T14:44:36.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51935 req_id = 0fc74f33-ae5d-48c1-a5ec-68523ac8b92e response_code = 200 uri = /v2p
23482025-01-17T14:44:36.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62298
23492025-01-17T14:44:36.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62298 req_id = 63ed0d8d-d30a-4e91-940b-08c31226eca4 response_code = 200 uri = /vpc-routes
23502025-01-17T14:44:37.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
23512025-01-17T14:44:37.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62298 req_id = 4e5e7aaf-8527-44ea-82ee-5dace708b04e response_code = 204 uri = /eip-gateways
23522025-01-17T14:44:37.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42104
23532025-01-17T14:44:37.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42104 req_id = 007540c5-24b5-4902-b074-a78c8d630234 response_code = 200 uri = /v2p
23542025-01-17T14:44:37.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62298 req_id = e3592433-8f94-4514-acc9-d47270d607d1 response_code = 204 uri = /vpc-routes
23552025-01-17T14:44:37.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61554
23562025-01-17T14:44:37.125ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23572025-01-17T14:44:37.167ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23582025-01-17T14:44:37.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61554 req_id = 1b7ffdb7-efb6-43a3-8b05-de30d9b783f7 response_code = 204 uri = /switch-ports
23592025-01-17T14:44:37.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61554 req_id = 926484d3-bdd4-417f-a8e2-f9daf9172800 response_code = 200 uri = /network-bootstore-config
23602025-01-17T14:44:37.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47578
23612025-01-17T14:44:37.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47578 req_id = b99a600e-7b86-4b72-801d-c4ec4d427664 response_code = 200 uri = /vpc-routes
23622025-01-17T14:44:37.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
23632025-01-17T14:44:37.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47578 req_id = e98d11bd-4944-4aae-ad4a-2ecc78fef338 response_code = 204 uri = /eip-gateways
23642025-01-17T14:44:37.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61228
23652025-01-17T14:44:37.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61228 req_id = 7cc1e981-96d9-4e4a-b13a-9ededb11981c response_code = 200 uri = /v2p
23662025-01-17T14:44:37.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47578 req_id = d4b05df7-ec5d-4bcb-990d-11980074e58a response_code = 204 uri = /vpc-routes
23672025-01-17T14:44:37.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59283
23682025-01-17T14:44:37.504ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23692025-01-17T14:44:37.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23702025-01-17T14:44:37.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88581 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59283 req_id = 29f9d796-d8d5-4624-9a8f-ad3fe6b7dbd7 response_code = 204 uri = /switch-ports
23712025-01-17T14:44:37.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59283 req_id = 7840dc98-4b15-4c6b-bcb8-1077c93e7aaa response_code = 200 uri = /network-bootstore-config
23722025-01-17T14:44:49.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6982 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 039bbcb6-7cb3-4423-9fc8-f3dee41c9390 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
23732025-01-17T14:44:59.552ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65463
23742025-01-17T14:44:59.552ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65463 req_id = fccb52d9-3289-4a08-ad19-cf83bec5228d response_code = 200 uri = /baseboard
23752025-01-17T14:45:06.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52143
23762025-01-17T14:45:06.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52143 req_id = da4990e9-8cea-4329-bc0a-65402c59902e response_code = 200 uri = /vpc-routes
23772025-01-17T14:45:06.542ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
23782025-01-17T14:45:06.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52143 req_id = e56f9e52-a6b3-44df-b006-2433a800e561 response_code = 204 uri = /eip-gateways
23792025-01-17T14:45:06.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52143 req_id = 654016b3-6fad-4bca-b2e3-6e039196d5f1 response_code = 204 uri = /vpc-routes
23802025-01-17T14:45:06.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38000
23812025-01-17T14:45:06.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38000 req_id = 7cedae4e-60d1-4390-8400-d0c30d77131f response_code = 200 uri = /v2p
23822025-01-17T14:45:06.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45499
23832025-01-17T14:45:06.655ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23842025-01-17T14:45:06.690ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23852025-01-17T14:45:06.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45499 req_id = 64a1596e-0007-4e72-9fb3-850cd2779382 response_code = 204 uri = /switch-ports
23862025-01-17T14:45:06.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45499 req_id = 42fee48c-8d93-4fa4-a131-725f3b13871c response_code = 200 uri = /network-bootstore-config
23872025-01-17T14:45:07.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41601
23882025-01-17T14:45:07.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41601 req_id = 8d78eb27-ee6f-4069-8798-1ebf1abfca28 response_code = 200 uri = /vpc-routes
23892025-01-17T14:45:07.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
23902025-01-17T14:45:07.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41601 req_id = 2c6863fe-5993-447a-8f0b-fa4ef2684d6c response_code = 204 uri = /eip-gateways
23912025-01-17T14:45:07.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41601 req_id = 42e21861-a8da-4db5-8588-701f7b50e36b response_code = 204 uri = /vpc-routes
23922025-01-17T14:45:07.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46549
23932025-01-17T14:45:07.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46549 req_id = f71c4eb3-514b-47c6-868d-6fd6a977c10d response_code = 200 uri = /v2p
23942025-01-17T14:45:07.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53380
23952025-01-17T14:45:07.432ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23962025-01-17T14:45:07.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23972025-01-17T14:45:07.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95167 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53380 req_id = e18d1dd4-992d-487d-8d82-ab7c39245309 response_code = 204 uri = /switch-ports
23982025-01-17T14:45:07.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36949
23992025-01-17T14:45:07.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53380 req_id = 6b0d0a70-efb6-4d03-9f4a-6ab20094e402 response_code = 200 uri = /network-bootstore-config
24002025-01-17T14:45:07.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36949 req_id = 932b6a8e-3125-4c6e-98b4-3a5abc13cb85 response_code = 200 uri = /vpc-routes
24012025-01-17T14:45:07.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
24022025-01-17T14:45:07.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36949 req_id = 31235585-0572-43c2-8937-7dd5ee8b1af7 response_code = 204 uri = /eip-gateways
24032025-01-17T14:45:07.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42234
24042025-01-17T14:45:07.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42234 req_id = 5f959583-d105-491b-8b6b-6e17f7069cd3 response_code = 200 uri = /v2p
24052025-01-17T14:45:07.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36949 req_id = ae1775b7-fa9a-4fa5-8f9a-9d6a1dc26631 response_code = 204 uri = /vpc-routes
24062025-01-17T14:45:07.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58660
24072025-01-17T14:45:07.731ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24082025-01-17T14:45:07.767ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24092025-01-17T14:45:07.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58660 req_id = 1484ee05-6054-48bc-90ac-f86a1cde28d2 response_code = 204 uri = /switch-ports
24102025-01-17T14:45:07.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58660 req_id = 3e8b44d1-862e-4237-ab65-5a6de6f1b224 response_code = 200 uri = /network-bootstore-config
24112025-01-17T14:45:19.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6068 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = b7174f05-9f57-45d3-86d7-c23ca678e262 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
24122025-01-17T14:45:29.587ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37938
24132025-01-17T14:45:29.587ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37938 req_id = f4722482-e0d6-4693-8e68-a753de1a8464 response_code = 200 uri = /baseboard
24142025-01-17T14:45:36.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52917
24152025-01-17T14:45:36.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52917 req_id = a27876e7-86c6-4769-a716-cbc4eefc2a30 response_code = 200 uri = /vpc-routes
24162025-01-17T14:45:36.406ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
24172025-01-17T14:45:36.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52917 req_id = a94c9677-66da-4f48-a1f7-f7e7528fb86f response_code = 204 uri = /eip-gateways
24182025-01-17T14:45:36.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52917 req_id = 35b5f044-c288-415d-a889-10d1c8a03bf5 response_code = 204 uri = /vpc-routes
24192025-01-17T14:45:36.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46100
24202025-01-17T14:45:36.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46100 req_id = 6d745565-9fe2-4413-bd72-774ffcfe75b4 response_code = 200 uri = /v2p
24212025-01-17T14:45:36.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41698
24222025-01-17T14:45:36.533ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24232025-01-17T14:45:36.572ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24242025-01-17T14:45:36.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41698 req_id = 318d4b90-072a-4835-bb80-7aaa7c65c6ad response_code = 204 uri = /switch-ports
24252025-01-17T14:45:36.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41698 req_id = eb4b7d55-f744-4210-94d8-9c26f8401eab response_code = 200 uri = /network-bootstore-config
24262025-01-17T14:45:36.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41636
24272025-01-17T14:45:36.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41636 req_id = 8e5b4418-b2de-425e-9f73-6c22027e3718 response_code = 200 uri = /vpc-routes
24282025-01-17T14:45:36.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
24292025-01-17T14:45:36.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41636 req_id = dfdb6181-4b76-493f-a8ea-f202b0a0e005 response_code = 204 uri = /eip-gateways
24302025-01-17T14:45:36.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41636 req_id = f023b4e6-143f-44b3-8e5f-7e710346bda0 response_code = 204 uri = /vpc-routes
24312025-01-17T14:45:37.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55283
24322025-01-17T14:45:37.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24332025-01-17T14:45:37.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24342025-01-17T14:45:37.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55283 req_id = 845d9462-7072-49c7-a0af-1ffee777b2c8 response_code = 204 uri = /switch-ports
24352025-01-17T14:45:37.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64028
24362025-01-17T14:45:37.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55283 req_id = 18ac2afc-dec5-4fd2-9917-153949620c21 response_code = 200 uri = /network-bootstore-config
24372025-01-17T14:45:37.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64028 req_id = 77dbbbe0-e18b-4afe-946a-280cf4d8b8ad response_code = 200 uri = /v2p
24382025-01-17T14:45:37.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37536
24392025-01-17T14:45:37.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37536 req_id = df5fb4c9-ac2d-419d-82e4-a359573b9683 response_code = 200 uri = /vpc-routes
24402025-01-17T14:45:37.598ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
24412025-01-17T14:45:37.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37536 req_id = 8df6eed9-d6a5-4dde-9e93-6c09ef18dc6c response_code = 204 uri = /eip-gateways
24422025-01-17T14:45:37.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39704
24432025-01-17T14:45:37.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39704 req_id = d6d0c08c-9d59-4377-9270-00e126f2ccee response_code = 200 uri = /v2p
24442025-01-17T14:45:37.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37536 req_id = 1f3c5f9d-a21c-4d44-9c39-1da789448aa0 response_code = 204 uri = /vpc-routes
24452025-01-17T14:45:37.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45044
24462025-01-17T14:45:37.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24472025-01-17T14:45:37.702ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24482025-01-17T14:45:37.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45044 req_id = 24922782-445c-4d21-aff8-778779540161 response_code = 204 uri = /switch-ports
24492025-01-17T14:45:37.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45044 req_id = e5c60711-3438-4579-b4f8-106a4160121f response_code = 200 uri = /network-bootstore-config
24502025-01-17T14:45:49.865ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8451 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 6a51d02a-d7e5-4b57-87de-b7933ed4867a response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
24512025-01-17T14:45:59.621ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43386
24522025-01-17T14:45:59.621ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43386 req_id = de921fff-779a-4722-9626-e1f4a094182b response_code = 200 uri = /baseboard
24532025-01-17T14:46:06.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41469
24542025-01-17T14:46:06.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41469 req_id = 96da789b-f294-4706-b65c-99fe625a124d response_code = 200 uri = /vpc-routes
24552025-01-17T14:46:06.464ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
24562025-01-17T14:46:06.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41469 req_id = 7551a882-5db6-4ca1-9326-fee882120a2c response_code = 204 uri = /eip-gateways
24572025-01-17T14:46:06.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41469 req_id = acaada5d-23e4-4e19-96e7-487de94a225e response_code = 204 uri = /vpc-routes
24582025-01-17T14:46:06.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53614
24592025-01-17T14:46:06.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53614 req_id = 027f7650-025e-41ed-98e2-d6298175e9c2 response_code = 200 uri = /v2p
24602025-01-17T14:46:06.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39876
24612025-01-17T14:46:06.741ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24622025-01-17T14:46:06.741ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24632025-01-17T14:46:06.741ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24642025-01-17T14:46:06.741ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24652025-01-17T14:46:06.741ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24662025-01-17T14:46:06.741ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24672025-01-17T14:46:06.741ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24682025-01-17T14:46:06.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39876 req_id = ba9e0f32-9bd9-4c4f-b63e-f9e6598f2f1d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24692025-01-17T14:46:06.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64736
24702025-01-17T14:46:06.841ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24712025-01-17T14:46:06.841ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24722025-01-17T14:46:06.841ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:177
24732025-01-17T14:46:06.842ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:177
24742025-01-17T14:46:06.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55322
24752025-01-17T14:46:06.848ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24762025-01-17T14:46:06.858ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24772025-01-17T14:46:06.858ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e
24782025-01-17T14:46:06.883ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24792025-01-17T14:46:06.883ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70
24802025-01-17T14:46:06.888ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24812025-01-17T14:46:06.909ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24822025-01-17T14:46:06.910ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40
24832025-01-17T14:46:06.935ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24842025-01-17T14:46:06.935ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbe5a810-e05c-4d89-9519-1329dff4d809
24852025-01-17T14:46:06.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103634 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55322 req_id = 8ae17e4c-6cb3-473b-8c1f-f2d256a5f641 response_code = 204 uri = /switch-ports
24862025-01-17T14:46:06.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55322 req_id = 78288953-c6fd-4a4a-b78d-e937d473f856 response_code = 200 uri = /network-bootstore-config
24872025-01-17T14:46:06.959ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24882025-01-17T14:46:06.959ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dfb17780-e3df-4bb3-93ca-7345897ec266
24892025-01-17T14:46:06.984ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24902025-01-17T14:46:06.984ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5
24912025-01-17T14:46:07.006ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24922025-01-17T14:46:07.006ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29b2ad89-d9a3-465b-9769-46ef936e0689
24932025-01-17T14:46:07.030ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24942025-01-17T14:46:07.030ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ee40d4b-ea13-4a21-b305-42890e26c365
24952025-01-17T14:46:07.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46809
24962025-01-17T14:46:07.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46809 req_id = ab867f38-d708-4055-91e7-f147acccb856 response_code = 200 uri = /vpc-routes
24972025-01-17T14:46:07.053ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24982025-01-17T14:46:07.053ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_938658cb-bbce-463a-aa57-19385de71d41
24992025-01-17T14:46:07.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 234562 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64736 req_id = 7044571c-01b3-422e-b15e-b1b175e65257 response_code = 200 uri = /inventory
25002025-01-17T14:46:07.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
25012025-01-17T14:46:07.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46809 req_id = d9e127c1-8b3f-4514-ada1-8537019068bf response_code = 204 uri = /eip-gateways
25022025-01-17T14:46:07.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46809 req_id = 41e35cde-0874-4695-8691-0ef73e1def95 response_code = 204 uri = /vpc-routes
25032025-01-17T14:46:07.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35552
25042025-01-17T14:46:07.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25052025-01-17T14:46:07.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25062025-01-17T14:46:07.304ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:177
25072025-01-17T14:46:07.311ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:177
25082025-01-17T14:46:07.327ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25092025-01-17T14:46:07.327ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e
25102025-01-17T14:46:07.354ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25112025-01-17T14:46:07.354ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70
25122025-01-17T14:46:07.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35133
25132025-01-17T14:46:07.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35133 req_id = 784956fb-78c8-4454-80be-fba44cf07002 response_code = 200 uri = /v2p
25142025-01-17T14:46:07.380ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25152025-01-17T14:46:07.380ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40
25162025-01-17T14:46:07.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56617
25172025-01-17T14:46:07.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25182025-01-17T14:46:07.408ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25192025-01-17T14:46:07.408ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbe5a810-e05c-4d89-9519-1329dff4d809
25202025-01-17T14:46:07.432ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25212025-01-17T14:46:07.432ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dfb17780-e3df-4bb3-93ca-7345897ec266
25222025-01-17T14:46:07.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25232025-01-17T14:46:07.457ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25242025-01-17T14:46:07.457ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5
25252025-01-17T14:46:07.482ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25262025-01-17T14:46:07.482ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29b2ad89-d9a3-465b-9769-46ef936e0689
25272025-01-17T14:46:07.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56617 req_id = b6544999-a332-4289-969c-3066896e9760 response_code = 204 uri = /switch-ports
25282025-01-17T14:46:07.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56617 req_id = 0d15ca02-f156-4f3b-8e3c-a9c99e1735f8 response_code = 200 uri = /network-bootstore-config
25292025-01-17T14:46:07.509ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25302025-01-17T14:46:07.509ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ee40d4b-ea13-4a21-b305-42890e26c365
25312025-01-17T14:46:07.532ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25322025-01-17T14:46:07.533ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_938658cb-bbce-463a-aa57-19385de71d41
25332025-01-17T14:46:07.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243452 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35552 req_id = 78cfde3a-60ce-4d41-b89e-13405d452428 response_code = 200 uri = /inventory
25342025-01-17T14:46:07.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54011
25352025-01-17T14:46:07.577ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25362025-01-17T14:46:07.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25372025-01-17T14:46:07.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25382025-01-17T14:46:07.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25392025-01-17T14:46:07.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25402025-01-17T14:46:07.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25412025-01-17T14:46:07.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25422025-01-17T14:46:07.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54011 req_id = c04ab580-52b3-4be2-a77d-56747ceb00b0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25432025-01-17T14:46:07.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59575
25442025-01-17T14:46:07.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59575 req_id = 2a50344a-f593-4931-bbfa-0ef71f85152c response_code = 200 uri = /vpc-routes
25452025-01-17T14:46:07.690ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
25462025-01-17T14:46:07.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59575 req_id = 97b3593c-0e20-4229-84e3-ba7336104ceb response_code = 204 uri = /eip-gateways
25472025-01-17T14:46:07.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59575 req_id = 14f2b24a-09e2-40df-a070-7c596591ce47 response_code = 204 uri = /vpc-routes
25482025-01-17T14:46:07.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41467
25492025-01-17T14:46:07.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41467 req_id = 2f370ce9-9cbf-4ed1-83f0-2057872fa5fb response_code = 200 uri = /v2p
25502025-01-17T14:46:07.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37409
25512025-01-17T14:46:07.803ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25522025-01-17T14:46:07.847ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25532025-01-17T14:46:07.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37409 req_id = 57072537-8c18-4b3f-9c92-83ece876560e response_code = 204 uri = /switch-ports
25542025-01-17T14:46:07.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37409 req_id = 73915fc5-0eaa-4219-8626-8857d0e260a4 response_code = 200 uri = /network-bootstore-config
25552025-01-17T14:46:07.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49778
25562025-01-17T14:46:07.950ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 43d91b73-a8c2-4952-914a-373096985ee1, kind: Service { id: 6f3cffd0-918e-4673-9c50-0e56a1b692df }, name: Name("external-dns-6f3cffd0-918e-4673-9c50-0e56a1b692df"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6336f355-bcf3-428f-b146-d8447e43890c, kind: Service { id: 71d6c099-d445-491f-aa89-b1d1f650000e }, name: Name("external-dns-71d6c099-d445-491f-aa89-b1d1f650000e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bc93976-a9fd-4342-a556-98e5529219b0, kind: Service { id: 19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7 }, name: Name("nexus-19cb16f5-9da3-43d3-acfe-6b0ebfa9aed7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0f7c414a-db15-418a-9f29-a80d5ce033fd, kind: Service { id: 2aa4435c-355c-4ea9-b80d-3f16933967df }, name: Name("nexus-2aa4435c-355c-4ea9-b80d-3f16933967df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 253])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1f8497d1-92f4-4293-9b3c-fe90ed088e0d, kind: Service { id: cbd77333-da98-4582-91d1-bc5647e8734c }, name: Name("nexus-cbd77333-da98-4582-91d1-bc5647e8734c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25572025-01-17T14:46:07.950ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25582025-01-17T14:46:07.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25592025-01-17T14:46:07.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25602025-01-17T14:46:07.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25612025-01-17T14:46:07.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25622025-01-17T14:46:07.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25632025-01-17T14:46:07.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49778 req_id = 33d04ca6-4e14-419a-9004-c911416c921a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25642025-01-17T14:46:08.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36562
25652025-01-17T14:46:08.467ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25662025-01-17T14:46:08.467ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25672025-01-17T14:46:08.467ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a2086011-cbfe-46de-a654-f46418d48eec/config/omicron-zones.json file = common/src/ledger.rs:177
25682025-01-17T14:46:08.467ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/config/omicron-zones.json file = common/src/ledger.rs:177
25692025-01-17T14:46:08.479ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 623683ac-fff8-4b77-ac97-9e3fd5ef602e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25702025-01-17T14:46:08.479ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_623683ac-fff8-4b77-ac97-9e3fd5ef602e
25712025-01-17T14:46:08.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52a7b8ea-97c3-4da3-9257-64e3ecb88c70 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25722025-01-17T14:46:08.498ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52a7b8ea-97c3-4da3-9257-64e3ecb88c70
25732025-01-17T14:46:08.523ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a32ead2c-ea11-4639-9370-ffe1738d2f40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25742025-01-17T14:46:08.523ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a32ead2c-ea11-4639-9370-ffe1738d2f40
25752025-01-17T14:46:08.543ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbe5a810-e05c-4d89-9519-1329dff4d809 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25762025-01-17T14:46:08.543ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbe5a810-e05c-4d89-9519-1329dff4d809
25772025-01-17T14:46:08.560ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfb17780-e3df-4bb3-93ca-7345897ec266 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25782025-01-17T14:46:08.560ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dfb17780-e3df-4bb3-93ca-7345897ec266
25792025-01-17T14:46:08.578ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0a9aed-4c4b-450d-ad89-87fe206addc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25802025-01-17T14:46:08.579ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6d0a9aed-4c4b-450d-ad89-87fe206addc5
25812025-01-17T14:46:08.598ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29b2ad89-d9a3-465b-9769-46ef936e0689 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25822025-01-17T14:46:08.598ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29b2ad89-d9a3-465b-9769-46ef936e0689
25832025-01-17T14:46:08.617ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ee40d4b-ea13-4a21-b305-42890e26c365 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25842025-01-17T14:46:08.617ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ee40d4b-ea13-4a21-b305-42890e26c365
25852025-01-17T14:46:08.633ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 938658cb-bbce-463a-aa57-19385de71d41 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25862025-01-17T14:46:08.633ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_938658cb-bbce-463a-aa57-19385de71d41
25872025-01-17T14:46:08.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36562 req_id = da76b45e-5faf-441b-80c6-1c573d0c7cc6 response_code = 200 uri = /inventory
25882025-01-17T14:46:19.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7031 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 96a917dc-0b4b-4ac7-a29c-76985141c4e5 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
25892025-01-17T14:46:29.653ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43034
25902025-01-17T14:46:29.653ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43034 req_id = e8b97c42-d6f5-4d7f-b0af-d4484b0631e1 response_code = 200 uri = /baseboard
25912025-01-17T14:46:36.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39099
25922025-01-17T14:46:36.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39099 req_id = 2d927734-0c6e-4ced-89bc-da9db91ffd2d response_code = 200 uri = /vpc-routes
25932025-01-17T14:46:36.358ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
25942025-01-17T14:46:36.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39099 req_id = 6367c270-e2d6-493d-9355-a97384bcd4a2 response_code = 204 uri = /eip-gateways
25952025-01-17T14:46:36.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39099 req_id = f0616325-1dcd-4b11-b6a5-ad8deb5e6651 response_code = 204 uri = /vpc-routes
25962025-01-17T14:46:36.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44063
25972025-01-17T14:46:36.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44063 req_id = 97a4a77f-e639-4a20-8dae-3d1511ed4ed5 response_code = 200 uri = /v2p
25982025-01-17T14:46:36.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55465
25992025-01-17T14:46:36.458ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26002025-01-17T14:46:36.501ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26012025-01-17T14:46:36.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55465 req_id = b0a493ba-cd1a-4419-b339-615bbdbd2003 response_code = 204 uri = /switch-ports
26022025-01-17T14:46:36.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55465 req_id = b2e17e6e-67b3-4c82-9353-ad5c15e7256b response_code = 200 uri = /network-bootstore-config
26032025-01-17T14:46:36.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33649
26042025-01-17T14:46:36.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33649 req_id = c5022af5-a666-434f-81fa-a628e84614a1 response_code = 200 uri = /v2p
26052025-01-17T14:46:37.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45956
26062025-01-17T14:46:37.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45956 req_id = a5afb7c7-7413-4696-a55f-70b97e9d90ef response_code = 200 uri = /vpc-routes
26072025-01-17T14:46:37.092ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
26082025-01-17T14:46:37.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45956 req_id = b7bd511f-54cb-4547-8f1c-39a14aea8179 response_code = 204 uri = /eip-gateways
26092025-01-17T14:46:37.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45956 req_id = 412592dd-0dbc-4f97-a071-610baa3dc70b response_code = 204 uri = /vpc-routes
26102025-01-17T14:46:37.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59842
26112025-01-17T14:46:37.147ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26122025-01-17T14:46:37.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26132025-01-17T14:46:37.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59842 req_id = d66cc61b-9bf3-4e74-af6c-b23cc006d2fc response_code = 204 uri = /switch-ports
26142025-01-17T14:46:37.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59842 req_id = 5a1e096e-d5f0-4508-932a-c311477d4d84 response_code = 200 uri = /network-bootstore-config
26152025-01-17T14:46:37.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43933
26162025-01-17T14:46:37.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43933 req_id = 15b0ea35-6281-4448-8383-c7172bb5e7ae response_code = 200 uri = /vpc-routes
26172025-01-17T14:46:37.495ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
26182025-01-17T14:46:37.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43933 req_id = 43c07928-c500-49ca-bb64-fc5df04e0149 response_code = 204 uri = /eip-gateways
26192025-01-17T14:46:37.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49456
26202025-01-17T14:46:37.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49456 req_id = 4340953e-c95e-41ba-91ea-f504f93979e4 response_code = 200 uri = /v2p
26212025-01-17T14:46:37.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43933 req_id = 4c9eb924-6e57-4cb5-8120-03d7e24d7fbc response_code = 204 uri = /vpc-routes
26222025-01-17T14:46:37.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41283
26232025-01-17T14:46:37.523ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26242025-01-17T14:46:37.565ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26252025-01-17T14:46:37.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108624 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41283 req_id = 95c38d43-b4c4-40a6-b212-3d6fcbc71e7c response_code = 204 uri = /switch-ports
26262025-01-17T14:46:37.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41283 req_id = 4fdecf26-22f7-4933-aa70-b9b10e11ca6b response_code = 200 uri = /network-bootstore-config
26272025-01-17T14:46:49.862ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6236 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = ec6960af-5696-4ab9-a6b4-9623f6270597 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
26282025-01-17T14:46:59.687ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53404
26292025-01-17T14:46:59.687ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53404 req_id = 4d530c9b-9fd6-41cc-9cef-1b7a4911c686 response_code = 200 uri = /baseboard
26302025-01-17T14:47:06.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33083
26312025-01-17T14:47:06.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33083 req_id = c612360e-54a4-45ab-aecd-51e30bd5089f response_code = 200 uri = /vpc-routes
26322025-01-17T14:47:06.496ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
26332025-01-17T14:47:06.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33083 req_id = c593d835-05d9-4101-9fae-a8150fc8a604 response_code = 204 uri = /eip-gateways
26342025-01-17T14:47:06.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33083 req_id = 2b9439b3-ad4b-45de-9127-f2da1d11b205 response_code = 204 uri = /vpc-routes
26352025-01-17T14:47:06.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49166
26362025-01-17T14:47:06.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49166 req_id = a4d324eb-f537-42e2-8116-203dc17f6140 response_code = 200 uri = /v2p
26372025-01-17T14:47:06.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63463
26382025-01-17T14:47:06.839ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26392025-01-17T14:47:06.879ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26402025-01-17T14:47:06.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63463 req_id = 6814314d-df22-463e-b7a6-d797a9a9c40e response_code = 204 uri = /switch-ports
26412025-01-17T14:47:06.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63463 req_id = 19109936-1672-4fbf-bf9a-1924c7bc27ed response_code = 200 uri = /network-bootstore-config
26422025-01-17T14:47:07.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35353
26432025-01-17T14:47:07.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35353 req_id = 0ed7566c-c49f-446b-8da7-df5dcb5575f0 response_code = 200 uri = /vpc-routes
26442025-01-17T14:47:07.153ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
26452025-01-17T14:47:07.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35353 req_id = de7432e4-ad01-476a-a45d-7aae938a8c1e response_code = 204 uri = /eip-gateways
26462025-01-17T14:47:07.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35353 req_id = 3e9a58b3-adc9-4763-bf07-f91c71d0f819 response_code = 204 uri = /vpc-routes
26472025-01-17T14:47:07.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58179
26482025-01-17T14:47:07.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26492025-01-17T14:47:07.319ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26502025-01-17T14:47:07.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58179 req_id = 58c38423-2a6c-4123-a7b0-aaac107a508c response_code = 204 uri = /switch-ports
26512025-01-17T14:47:07.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58179 req_id = 414306b1-571b-45a2-8b8f-e204eb3591a4 response_code = 200 uri = /network-bootstore-config
26522025-01-17T14:47:07.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55047
26532025-01-17T14:47:07.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55047 req_id = 0ea1cf4c-ef1c-4413-87e7-015594a7113b response_code = 200 uri = /v2p
26542025-01-17T14:47:07.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52200
26552025-01-17T14:47:07.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52200 req_id = f37a9918-27ac-4ed7-a3d7-f125bc59cd3a response_code = 200 uri = /vpc-routes
26562025-01-17T14:47:07.467ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
26572025-01-17T14:47:07.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52200 req_id = c1b8db16-c545-4741-ba32-6ed98a2bcb06 response_code = 204 uri = /eip-gateways
26582025-01-17T14:47:07.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52200 req_id = b5314c52-1c31-4df3-ba5f-9cd8b8dd77d6 response_code = 204 uri = /vpc-routes
26592025-01-17T14:47:07.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40856
26602025-01-17T14:47:07.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40856 req_id = f773444f-c8e0-41e9-a82b-8f0608a572b8 response_code = 200 uri = /v2p
26612025-01-17T14:47:07.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46817
26622025-01-17T14:47:07.765ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26632025-01-17T14:47:07.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26642025-01-17T14:47:07.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91971 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46817 req_id = f139df28-febc-48d6-9501-239b28a7d68b response_code = 204 uri = /switch-ports
26652025-01-17T14:47:07.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46817 req_id = 08303212-f507-4396-8118-1f58b1296a29 response_code = 200 uri = /network-bootstore-config
26662025-01-17T14:47:19.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7601 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = c04ff97c-b500-47e0-b225-14a466b38988 response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
26672025-01-17T14:47:29.721ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48306
26682025-01-17T14:47:29.721ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48306 req_id = 945b0a6b-90e5-42c0-a1b7-831e778037b4 response_code = 200 uri = /baseboard
26692025-01-17T14:47:31.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45286
26702025-01-17T14:47:31.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45286 req_id = 703664cc-5327-4e55-88cc-75266b861c6c response_code = 200 uri = /v2p
26712025-01-17T14:47:31.069ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(11324336) }
26722025-01-17T14:47:31.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45286 req_id = c434eee0-88d4-4d93-98ba-3779f2013df4 response_code = 204 uri = /v2p
26732025-01-17T14:47:31.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35885
26742025-01-17T14:47:31.193ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a92ebdd5-6025-4cbb-991c-08db3ccc03a1, kind: Instance { id: 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11324336), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a92ebdd5-6025-4cbb-991c-08db3ccc03a1, kind: Instance { id: 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11324336), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a92ebdd5-6025-4cbb-991c-08db3ccc03a1, kind: Instance { id: 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11324336), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11324336))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a92ebdd5-6025-4cbb-991c-08db3ccc03a1, kind: Instance { id: 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11324336), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 63426ebf-85f2-4bd0-9172-7b56ed84d155, slot: 0, read_only: false, vcr_json: .., name: "disk-915d9a2f5b2" }], boot_settings: Some(InstanceBootSettings { order: [63426ebf-85f2-4bd0-9172-7b56ed84d155] }), cloud_init_bytes: Some(..) } instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca metadata = InstanceMetadata { silo_id: 106d192b-e2cc-4b25-a31a-48e45ec0f090, project_id: 2b4cdb58-6542-45dd-b1c8-f50485a5deeb } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-17T14:47:31.187269787Z }
26752025-01-17T14:47:31.193ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca migration_id = None propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26762025-01-17T14:47:31.193ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca migration_id = None propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a92ebdd5-6025-4cbb-991c-08db3ccc03a1, kind: Instance { id: 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11324336), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a92ebdd5-6025-4cbb-991c-08db3ccc03a1, kind: Instance { id: 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11324336), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a92ebdd5-6025-4cbb-991c-08db3ccc03a1, kind: Instance { id: 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11324336), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11324336))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a92ebdd5-6025-4cbb-991c-08db3ccc03a1, kind: Instance { id: 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11324336), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 63426ebf-85f2-4bd0-9172-7b56ed84d155, slot: 0, read_only: false, vcr_json: .., name: "disk-915d9a2f5b2" }], boot_settings: Some(InstanceBootSettings { order: [63426ebf-85f2-4bd0-9172-7b56ed84d155] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-17T14:47:31.187269787Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26772025-01-17T14:47:31.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9472 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35885 req_id = 4da60d6d-60a7-4e17-bae3-07f93136d43a response_code = 200 uri = /vmms/08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26782025-01-17T14:47:31.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52619
26792025-01-17T14:47:31.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52619 req_id = 585c0622-18e0-49e3-b8a8-850745536f3e response_code = 200 uri = /vmms/08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00/state
26802025-01-17T14:47:31.316ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 11324336 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26812025-01-17T14:47:31.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26822025-01-17T14:47:31.355ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 file = illumos-utils/src/zone.rs:325 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26832025-01-17T14:47:31.376ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 file = illumos-utils/src/zone.rs:363 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26842025-01-17T14:47:31.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44041
26852025-01-17T14:47:31.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44041 req_id = eec94086-f7fa-469c-8759-00b9e51f921f response_code = 200 uri = /vpc-routes
26862025-01-17T14:47:31.409ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {a92ebdd5-6025-4cbb-991c-08db3ccc03a1: {10.151.2.176: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}, 10.151.2.175: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}}} }
26872025-01-17T14:47:32.684ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26882025-01-17T14:47:32.684ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26892025-01-17T14:47:32.947ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 47.906306ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26902025-01-17T14:47:33.006ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 68.916222ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26912025-01-17T14:47:33.093ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 225.145643ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26922025-01-17T14:47:33.332ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 203.468619ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26932025-01-17T14:47:33.547ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 1.152149559s file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26942025-01-17T14:47:34.711ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 1.149020813s file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26952025-01-17T14:47:35.872ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 1.281159415s file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
26962025-01-17T14:47:36.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43981
26972025-01-17T14:47:36.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61684
26982025-01-17T14:47:36.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61684 req_id = c46caaae-f03f-4f78-8d58-f0a06231fa57 response_code = 200 uri = /vpc-routes
26992025-01-17T14:47:36.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {a92ebdd5-6025-4cbb-991c-08db3ccc03a1: {10.151.2.176: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}, 10.151.2.175: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}}} }
27002025-01-17T14:47:36.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61684 req_id = 9ab54a99-4b2c-4d7f-91c9-de2af287d497 response_code = 204 uri = /eip-gateways
27012025-01-17T14:47:36.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59898
27022025-01-17T14:47:36.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27032025-01-17T14:47:36.525ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27042025-01-17T14:47:36.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59898 req_id = 4446aef9-e036-49e3-9e8e-0ba4348551ce response_code = 204 uri = /switch-ports
27052025-01-17T14:47:36.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 453 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61684 req_id = 5afc4457-334a-4837-869e-dc9e7cf73578 response_code = 204 uri = /vpc-routes
27062025-01-17T14:47:36.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59898 req_id = 4187d9ba-b7d3-4e79-a54a-755a414189ab response_code = 200 uri = /network-bootstore-config
27072025-01-17T14:47:36.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34800
27082025-01-17T14:47:36.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34800 req_id = 353d6447-fb8e-4a6f-9c1d-9198bb61bc4a response_code = 200 uri = /v2p
27092025-01-17T14:47:36.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38001
27102025-01-17T14:47:37.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49634
27112025-01-17T14:47:37.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49634 req_id = b3eebe74-45df-4f85-8589-785aaa81af30 response_code = 200 uri = /vpc-routes
27122025-01-17T14:47:37.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {a92ebdd5-6025-4cbb-991c-08db3ccc03a1: {10.151.2.175: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}, 10.151.2.176: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}}} }
27132025-01-17T14:47:37.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49634 req_id = 3d7403cb-252f-4dab-9beb-c0244578caa6 response_code = 204 uri = /eip-gateways
27142025-01-17T14:47:37.168ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 533.845707ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 zone = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27152025-01-17T14:47:37.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58371
27162025-01-17T14:47:37.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58371 req_id = 4afeec8d-eda6-4e98-b248-cfb2da561d6e response_code = 200 uri = /v2p
27172025-01-17T14:47:37.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49634 req_id = 1bc1032d-e9c4-4824-9327-189e89e0400b response_code = 204 uri = /vpc-routes
27182025-01-17T14:47:37.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35174
27192025-01-17T14:47:37.276ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27202025-01-17T14:47:37.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27212025-01-17T14:47:37.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35174 req_id = 701ef277-a70a-4f2b-aae3-1e7585ff363b response_code = 204 uri = /switch-ports
27222025-01-17T14:47:37.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62262
27232025-01-17T14:47:37.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35174 req_id = 842aba4a-e57a-49f1-ab9a-e372b2623d95 response_code = 200 uri = /network-bootstore-config
27242025-01-17T14:47:37.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43372
27252025-01-17T14:47:37.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43372 req_id = 22224f04-4eef-41aa-8c5c-52f7e6c8a014 response_code = 200 uri = /v2p
27262025-01-17T14:47:37.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65507
27272025-01-17T14:47:37.632ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27282025-01-17T14:47:37.670ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27292025-01-17T14:47:37.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65507 req_id = b1782611-f3f3-4c1a-8986-b362b7bb1dc9 response_code = 204 uri = /switch-ports
27302025-01-17T14:47:37.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65507 req_id = 7eb5c0aa-ca11-479d-8084-505ad480c8b2 response_code = 200 uri = /network-bootstore-config
27312025-01-17T14:47:37.760ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 file = sled-agent/src/instance.rs:2068 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27322025-01-17T14:47:37.771ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 59.261857ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27332025-01-17T14:47:37.840ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 61.777648ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27342025-01-17T14:47:37.915ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 227.194549ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27352025-01-17T14:47:38.153ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00") failed: Property not found. retry in 256.546186ms file = illumos-utils/src/svc.rs:42 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27362025-01-17T14:47:38.421ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27372025-01-17T14:47:38.460ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27382025-01-17T14:47:38.599ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27392025-01-17T14:47:38.633ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
27402025-01-17T14:47:38.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1266719 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62262 req_id = 834065d3-6659-486e-a02e-7a41d2f65442 response_code = 200 uri = /vmms/08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00/state
27412025-01-17T14:47:38.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2248265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43981 req_id = ad4e74c5-e7f3-43d0-92ca-b17b02b31ff9 response_code = 200 uri = /vmms/08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00/state
27422025-01-17T14:47:38.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7225083 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44041 req_id = 3a5d1b53-2930-406c-a01b-fb795f1193cf response_code = 204 uri = /eip-gateways
27432025-01-17T14:47:38.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1651995 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38001 req_id = 7c2f6f3f-5c85-448d-a462-a36f8c89a9c7 response_code = 200 uri = /vmms/08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00/state
27442025-01-17T14:47:38.633ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-17T14:47:38.633229887Z } file = sled-agent/src/instance.rs:781 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27452025-01-17T14:47:38.633ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T14:47:38.633229887Z } propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27462025-01-17T14:47:38.633ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T14:47:38.633229887Z }, migration_in: None, migration_out: None }
27472025-01-17T14:47:38.681ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-17T14:47:38.681225755Z } file = sled-agent/src/instance.rs:781 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27482025-01-17T14:47:38.681ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T14:47:38.681225755Z } propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27492025-01-17T14:47:38.681ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T14:47:38.681225755Z }, migration_in: None, migration_out: None }
27502025-01-17T14:47:38.746ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 9eab706d-6f1c-469c-9e4d-c3777c9d4a89, version: 3 } old_vers = RouterVersion { router_id: 9eab706d-6f1c-469c-9e4d-c3777c9d4a89, version: 3 } subnet = RouterId { vni: Vni(11324336), kind: System }
27512025-01-17T14:47:38.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44041 req_id = 40ca1cec-d4c4-4ece-9a41-32f99b08e83a response_code = 204 uri = /vpc-routes
27522025-01-17T14:47:38.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48958
27532025-01-17T14:47:38.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48958 req_id = 9566ab84-d5f2-4dc5-8884-26bdb0ea1d8c response_code = 200 uri = /vpc-routes
27542025-01-17T14:47:38.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {a92ebdd5-6025-4cbb-991c-08db3ccc03a1: {10.151.2.176: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}, 10.151.2.175: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}}} }
27552025-01-17T14:47:38.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48958 req_id = c5c316b2-a121-46f2-b815-841b905c8d88 response_code = 204 uri = /eip-gateways
27562025-01-17T14:47:38.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48958 req_id = 482f4e21-5a37-4a8d-9b26-938f8cf804d6 response_code = 204 uri = /vpc-routes
27572025-01-17T14:47:48.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62193
27582025-01-17T14:47:48.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 725 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62193 req_id = 206ae4a7-2b23-4a6f-b778-7d58760d097b response_code = 200 uri = /vmms/08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00/state
27592025-01-17T14:47:48.970ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-17T14:47:48.970546062Z } file = sled-agent/src/instance.rs:781 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27602025-01-17T14:47:48.970ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T14:47:48.970546062Z } propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27612025-01-17T14:47:48.970ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T14:47:48.970546062Z }, migration_in: None, migration_out: None }
27622025-01-17T14:47:49.057ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-17T14:47:49.057158415Z } file = sled-agent/src/instance.rs:781 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27632025-01-17T14:47:49.057ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-17T14:47:49.057158415Z } propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27642025-01-17T14:47:49.057ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27652025-01-17T14:47:49.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27662025-01-17T14:47:49.057ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 18252044017767787892 n_samples = 6 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
27672025-01-17T14:47:49.057ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 8645581351341100026 n_samples = 6 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
27682025-01-17T14:47:49.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27692025-01-17T14:47:49.057ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/8f586687-d9a7-42a8-a738-8f3a0e5e458f/debug/bundle/zone", "/pool/int/a2086011-cbfe-46de-a654-f46418d48eec/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/623683ac-fff8-4b77-ac97-9e3fd5ef602e/crypt/debug", "/pool/ext/52a7b8ea-97c3-4da3-9257-64e3ecb88c70/crypt/debug", "/pool/ext/a32ead2c-ea11-4639-9370-ffe1738d2f40/crypt/debug", "/pool/ext/cbe5a810-e05c-4d89-9519-1329dff4d809/crypt/debug", "/pool/ext/dfb17780-e3df-4bb3-93ca-7345897ec266/crypt/debug", "/pool/ext/6d0a9aed-4c4b-450d-ad89-87fe206addc5/crypt/debug", "/pool/ext/29b2ad89-d9a3-465b-9769-46ef936e0689/crypt/debug", "/pool/ext/9ee40d4b-ea13-4a21-b305-42890e26c365/crypt/debug", "/pool/ext/938658cb-bbce-463a-aa57-19385de71d41/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27702025-01-17T14:47:49.765ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00", bundle_id: 6f4730d3-4334-473d-9b5c-f1451c50d922 }, time_created: 2025-01-17T14:47:49.058052903Z, version: 0, cause: TerminatedInstance }
27712025-01-17T14:47:49.765ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 file = sled-agent/src/instance.rs:1314 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27722025-01-17T14:47:49.865ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8936 local_addr = [fd00:1122:3344:101::1]:58824 method = GET remote_addr = [fd00:1122:3344:101::d]:45374 req_id = 0997d646-33dc-4bcc-b265-f7078d2e36cf response_code = 200 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb uri = /ca190028-ca00-4273-bff2-dd6ceb9e6ccb
27732025-01-17T14:47:51.586ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27742025-01-17T14:47:51.602ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(11324336), kind: System }
27752025-01-17T14:47:51.602ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(11324336), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27762025-01-17T14:47:51.603ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T14:47:51.603028267Z }, migration_in: None, migration_out: None }
27772025-01-17T14:47:51.665ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T14:47:51.603028267Z }, migration_in: None, migration_out: None }
27782025-01-17T14:47:51.670ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = 191f9ed3-1b6d-4eb7-9c7d-97122e14c3ca propolis_id = 08ce3c23-6cf7-4bfe-a2ee-d3bf65958f00
27792025-01-17T14:47:52.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55384
27802025-01-17T14:47:52.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55384 req_id = 3946dc48-80b4-40af-80cb-74a86703d745 response_code = 200 uri = /v2p
27812025-01-17T14:47:52.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41634
27822025-01-17T14:47:52.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41634 req_id = 6f595992-ee5a-4df4-863e-09a0172bc66b response_code = 200 uri = /vpc-routes
27832025-01-17T14:47:52.973ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {a92ebdd5-6025-4cbb-991c-08db3ccc03a1: {10.151.2.175: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}, 10.151.2.176: {37131da8-7cc2-4197-9d1d-9c3d0d1e4037}}} }
27842025-01-17T14:47:52.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41634 req_id = ffd953bf-4562-4661-b02d-59636e83c799 response_code = 204 uri = /eip-gateways
27852025-01-17T14:47:52.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41634 req_id = 2659532d-8d6a-49c3-8ba1-69049a92ac0d response_code = 204 uri = /vpc-routes
27862025-01-17T14:47:54.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51995
27872025-01-17T14:47:54.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51995 req_id = d62d63ab-0caf-4f23-870e-604a4a2e257b response_code = 200 uri = /v2p
27882025-01-17T14:47:54.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36726
27892025-01-17T14:47:54.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36726 req_id = 37643915-4021-4f44-bc95-2ffc950a0275 response_code = 200 uri = /vpc-routes
27902025-01-17T14:47:54.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
27912025-01-17T14:47:54.996ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb
27922025-01-17T14:47:54.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36726 req_id = 4918b01c-3730-4e34-9bf3-76cb729ef380 response_code = 204 uri = /eip-gateways
27932025-01-17T14:47:55.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36726 req_id = abfb01f0-6602-4682-83b8-c85e77225dde response_code = 204 uri = /vpc-routes
27942025-01-17T14:47:56.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38569
27952025-01-17T14:47:56.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38569 req_id = ef9c54b2-a095-480d-a71f-9a1b57909de6 response_code = 200 uri = /vpc-routes
27962025-01-17T14:47:56.474ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = ca190028-ca00-4273-bff2-dd6ceb9e6ccb values = ExternalIpGatewayMap { mappings: {} }
27972025-01-17T14:47:56.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38569 req_id = a51c8748-686d-42f2-8a92-483f7e7d476a response_code = 204 uri = /eip-gateways
27982025-01-17T14:47:56.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38569 req_id = 0334c438-05ae-428a-b7fa-b8a4816f1a7f response_code = 204 uri = /vpc-routes