Max level shown:
1 [ Jan 7 05:05:04 Enabled. ]
2 [ Jan 7 05:05:04 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 7 05:05:04 Method "start" exited with status 0. ]
4 [ Jan 7 05:05:04 Rereading configuration. ]
5 [ Jan 7 05:05:04 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-07T05:05:04.737ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-07T05:05:04.737ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-07T05:05:04.791ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-07T05:05:04.791ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-07T05:05:04.907ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-07T05:05:04.916ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-07T05:05:04.924ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-07T05:05:05.526ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-07T05:05:05.669ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-07T05:05:05.669ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-07T05:05:05.670ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-07T05:05:05.670ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-07T05:05:05.670ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-07T05:05:05.670ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-07T05:05:05.673ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-07T05:05:05.673ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-07T05:05:05.673ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-07T05:05:05.673ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-07T05:05:05.673ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-07T05:05:05.673ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-07T05:05:05.673ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-07T05:05:05.673ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-07T05:05:05.673ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-07T05:05:05.685ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-07T05:05:05.685ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool)
322025-01-07T05:05:05.786ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal }
332025-01-07T05:05:06.158ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-07T05:05:06.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-07T05:05:06.158ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-07T05:05:06.158ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-07T05:05:06.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-07T05:05:06.158ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-07T05:05:06.158ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-07T05:05:06.167ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-07T05:05:06.167ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool)
422025-01-07T05:05:06.259ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal }
432025-01-07T05:05:06.633ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-07T05:05:06.633ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-07T05:05:06.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-01-07T05:05:06.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612025-01-07T05:05:06.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
642025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
662025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-07T05:05:06.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
692025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
702025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-01-07T05:05:06.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-07T05:05:06.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
832025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-07T05:05:06.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-07T05:05:06.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942025-01-07T05:05:06.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-07T05:05:06.634ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-07T05:05:06.634ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1002025-01-07T05:05:06.634ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1012025-01-07T05:05:06.634ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022025-01-07T05:05:06.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-07T05:05:06.634ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-07T05:05:06.634ZINFOSledAgent (bootstore): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-07T05:05:06.634ZINFOSledAgent (bootstore): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-07T05:05:06.634ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-07T05:05:06.634ZINFOSledAgent (bootstore): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-07T05:05:06.634ZINFOSledAgent (bootstore): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-07T05:05:06.634ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-07T05:05:06.634ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-07T05:05:06.634ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-07T05:05:06.645ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-07T05:05:06.645ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 7560, tv_nsec: 540718903 } time_to_next_cleanup = 599.999938629s
1142025-01-07T05:05:06.645ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-07T05:05:06.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-07T05:05:06.645ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-07T05:05:06.648ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-07T05:05:06.649ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-07T05:05:06.650ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-07T05:05:06.651ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212025-01-07T05:05:06.651ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-07T05:05:06.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-07T05:05:06.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-07T05:05:06.651ZINFOSledAgent (RSS): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-07T05:05:06.651ZINFOSledAgent (RSS): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-07T05:05:06.651ZINFOSledAgent (RSS): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-07T05:05:06.651ZINFOSledAgent (RSS): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-07T05:05:06.651ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292025-01-07T05:05:06.651ZINFOSledAgent (RSS): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-07T05:05:06.651ZINFOSledAgent (RSS): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-07T05:05:06.651ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322025-01-07T05:05:06.651ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-07T05:05:06.651ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-07T05:05:06.651ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-07T05:05:06.651ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-07T05:05:06.652ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-07T05:05:06.652ZINFOSledAgent (bootstore): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-07T05:05:06.652ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-07T05:05:06.652ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ed42aaef-618c-4920-bad3-c2a5ed2fd546 (sled), rack_id: 7854418f-54cc-4b31-99a7-d8502eb03ebe, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-07T05:05:06.653ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-07T05:05:06.653ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-07T05:05:06.657ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-07T05:05:06.663ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-07T05:05:06.663ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-07T05:05:06.668ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-07T05:05:06.668ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-07T05:05:06.668ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:60752
1482025-01-07T05:05:06.668ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ed42aaef-618c-4920-bad3-c2a5ed2fd546 (sled), rack_id: 7854418f-54cc-4b31-99a7-d8502eb03ebe, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-07T05:05:06.668ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-07T05:05:06.668ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-07T05:05:06.668ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1522025-01-07T05:05:06.668ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1532025-01-07T05:05:06.668ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542025-01-07T05:05:06.668ZINFOSledAgent (StorageManager): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-07T05:05:06.668ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-07T05:05:06.668ZINFOSledAgent (StorageManager): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-07T05:05:06.668ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-07T05:05:06.668ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-07T05:05:06.668ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-07T05:05:06.668ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-07T05:05:06.668ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-07T05:05:06.685ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-07T05:05:06.705ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-07T05:05:06.722ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-07T05:05:06.729ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
1662025-01-07T05:05:06.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-07T05:05:06.729ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
1682025-01-07T05:05:06.729ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-07T05:05:06.732ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 132.57776ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8ea976d5-8aa4-4f17-9c92-f4bb4f38e578", "content-length": "124", "date": "Tue, 07 Jan 2025 05:05:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8ea976d5-8aa4-4f17-9c92-f4bb4f38e578" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-07T05:05:06.742ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_0903eba0-a42b-4f15-a659-5669cab98e49/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-07T05:05:06.766ZINFOSledAgent: successfully created encrypted zvol: name="oxi_0903eba0-a42b-4f15-a659-5669cab98e49/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-07T05:05:06.767ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_0903eba0-a42b-4f15-a659-5669cab98e49/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-07T05:05:06.771ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
1742025-01-07T05:05:06.771ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-07T05:05:06.771ZINFOSledAgent (BackingFs): Ensuring dataset oxi_0903eba0-a42b-4f15-a659-5669cab98e49/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-07T05:05:06.846ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-01-07T05:05:06.865ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782025-01-07T05:05:06.866ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 179.168628ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "71cac369-61aa-4fc3-a3fd-b10e2a691c43", "content-length": "124", "date": "Tue, 07 Jan 2025 05:05:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "71cac369-61aa-4fc3-a3fd-b10e2a691c43" } file = clients/ddm-admin-client/src/lib.rs:177
1792025-01-07T05:05:07.046ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-07T05:05:07.047ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 99.762981ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3a087628-870c-41d3-98f0-13743f728c0b", "content-length": "124", "date": "Tue, 07 Jan 2025 05:05:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3a087628-870c-41d3-98f0-13743f728c0b" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-07T05:05:07.066ZINFOSledAgent (BackingFs): Mounting oxi_0903eba0-a42b-4f15-a659-5669cab98e49/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-07T05:05:07.079ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-07T05:05:07.079ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-07T05:05:07.079ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-07T05:05:07.079ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-07T05:05:07.149ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-07T05:05:07.149ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 113.262558ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1fabf576-e463-46e3-84ed-e51f027e177c", "content-length": "124", "date": "Tue, 07 Jan 2025 05:05:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1fabf576-e463-46e3-84ed-e51f027e177c" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-07T05:05:07.263ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-07T05:05:07.264ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 134.538031ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d7602887-05a0-421d-b074-d4940f624a9f", "content-length": "124", "date": "Tue, 07 Jan 2025 05:05:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d7602887-05a0-421d-b074-d4940f624a9f" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-07T05:05:07.399ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-07T05:05:07.400ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 134.618ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6aac08c5-2bdb-4d10-b359-85d30af33fff", "content-length": "124", "date": "Tue, 07 Jan 2025 05:05:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6aac08c5-2bdb-4d10-b359-85d30af33fff" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-07T05:05:07.536ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-07T05:05:07.536ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 216.150811ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "033755af-842e-4e90-9c8b-f3c094801468", "content-length": "124", "date": "Tue, 07 Jan 2025 05:05:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "033755af-842e-4e90-9c8b-f3c094801468" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-07T05:05:07.753ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952025-01-07T05:05:07.754ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 297.703518ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "745ac63b-beb2-4f09-abb6-e6315b093a28", "content-length": "124", "date": "Tue, 07 Jan 2025 05:05:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "745ac63b-beb2-4f09-abb6-e6315b093a28" } file = clients/ddm-admin-client/src/lib.rs:177
1962025-01-07T05:05:07.822ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
1972025-01-07T05:05:07.827ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:46453 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
1982025-01-07T05:05:07.827ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
1992025-01-07T05:05:07.827ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:46453 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2002025-01-07T05:05:07.829ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 346.361225ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2012025-01-07T05:05:07.830ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2022025-01-07T05:05:07.830ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2032025-01-07T05:05:07.830ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2042025-01-07T05:05:07.830ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052025-01-07T05:05:08.053ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062025-01-07T05:05:08.176ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 588.610212ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2072025-01-07T05:05:08.767ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.363338936s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2082025-01-07T05:05:10.132ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.189000281s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2092025-01-07T05:05:10.351ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2102025-01-07T05:05:10.351ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2112025-01-07T05:05:10.351ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2122025-01-07T05:05:10.351ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2132025-01-07T05:05:10.351ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2142025-01-07T05:05:10.351ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2152025-01-07T05:05:10.353ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2162025-01-07T05:05:10.354ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2172025-01-07T05:05:10.354ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='7302d162-68f2-45dc-a2f1-c9d96a16fc35'/> <propval type="astring" name="rack_id" value='7854418f-54cc-4b31-99a7-d8502eb03ebe'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fefa:580'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='7854418f-54cc-4b31-99a7-d8502eb03ebe'/> <propval type="astring" name="sled_id" value='ed42aaef-618c-4920-bad3-c2a5ed2fd546'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='ed42aaef-618c-4920-bad3-c2a5ed2fd546'/> <propval type="astring" name="rack_uuid" value='7854418f-54cc-4b31-99a7-d8502eb03ebe'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='ed42aaef-618c-4920-bad3-c2a5ed2fd546'/> <propval type="astring" name="rack_uuid" value='7854418f-54cc-4b31-99a7-d8502eb03ebe'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182025-01-07T05:05:10.354ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192025-01-07T05:05:10.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 28.954534ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-07T05:05:10.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 137.694294ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212025-01-07T05:05:10.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 285.696558ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-07T05:05:11.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 203.617705ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232025-01-07T05:05:11.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 545.880498ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-07T05:05:12.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 503.275661ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252025-01-07T05:05:12.349ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.826243736s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2262025-01-07T05:05:12.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 933.268206ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272025-01-07T05:05:14.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 500.01076ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282025-01-07T05:05:14.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 822.756441ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292025-01-07T05:05:15.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 998.042795ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302025-01-07T05:05:17.043ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/nexus.rs:527 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2312025-01-07T05:05:17.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-01-07T05:05:17.074ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2332025-01-07T05:05:17.075ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2342025-01-07T05:05:17.075ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2352025-01-07T05:05:17.075ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2362025-01-07T05:05:17.075ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372025-01-07T05:05:17.075ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2382025-01-07T05:05:17.076ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2392025-01-07T05:05:17.076ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2402025-01-07T05:05:17.076ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2412025-01-07T05:05:17.252ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:60752
2422025-01-07T05:05:17.252ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2432025-01-07T05:05:17.252ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2442025-01-07T05:05:17.257ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2452025-01-07T05:05:17.920ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2462025-01-07T05:05:17.922ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2472025-01-07T05:05:17.923ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2482025-01-07T05:05:17.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44146
2492025-01-07T05:05:17.935ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2502025-01-07T05:05:17.935ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2512025-01-07T05:05:17.935ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:188
2522025-01-07T05:05:17.935ZINFOSledAgent (ServiceManager): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:188
2532025-01-07T05:05:17.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44146 req_id = 2320c627-f533-4d10-b6f3-1ef0dd469c78 response_code = 200 uri = /inventory
2542025-01-07T05:05:17.950ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2552025-01-07T05:05:17.950ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2562025-01-07T05:05:17.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47240
2572025-01-07T05:05:17.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47240 req_id = 227a0ab0-c34e-47ad-9af1-b3c85e5f7dd7 response_code = 200 uri = /sled-role
2582025-01-07T05:05:18.024ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 80c07254-0fdd-4867-8e4b-79f8c8a64e7b (physical_disk), pool_id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 89c56141-383a-4748-9b9f-54c96ac16390 (physical_disk), pool_id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a43a5aea-d20d-4eaa-abf7-dc18b62b0a4c (physical_disk), pool_id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 89690ebe-2f9f-4ff5-9f52-decd86d00880 (physical_disk), pool_id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 4b6faf36-ca89-41a4-a23c-ada0fb4875f3 (physical_disk), pool_id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a698dcf7-122d-478c-801a-002ddbeb0f20 (physical_disk), pool_id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3efbb5da-58d2-4143-9429-84ddeb608e3f (physical_disk), pool_id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1b5b6d0e-f921-4a68-b02c-e3f55241dc10 (physical_disk), pool_id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 33d6e002-fb32-4917-9a7c-d2f9a4d13855 (physical_disk), pool_id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2592025-01-07T05:05:18.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52777
2602025-01-07T05:05:18.025ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2612025-01-07T05:05:18.025ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 80c07254-0fdd-4867-8e4b-79f8c8a64e7b (physical_disk), pool_id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 89c56141-383a-4748-9b9f-54c96ac16390 (physical_disk), pool_id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a43a5aea-d20d-4eaa-abf7-dc18b62b0a4c (physical_disk), pool_id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 89690ebe-2f9f-4ff5-9f52-decd86d00880 (physical_disk), pool_id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 4b6faf36-ca89-41a4-a23c-ada0fb4875f3 (physical_disk), pool_id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a698dcf7-122d-478c-801a-002ddbeb0f20 (physical_disk), pool_id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3efbb5da-58d2-4143-9429-84ddeb608e3f (physical_disk), pool_id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1b5b6d0e-f921-4a68-b02c-e3f55241dc10 (physical_disk), pool_id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 33d6e002-fb32-4917-9a7c-d2f9a4d13855 (physical_disk), pool_id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2622025-01-07T05:05:18.025ZINFOSledAgent (StorageManager): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2632025-01-07T05:05:18.025ZINFOSledAgent (StorageManager): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2642025-01-07T05:05:18.025ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2652025-01-07T05:05:18.025ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2662025-01-07T05:05:18.025ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2672025-01-07T05:05:18.025ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2682025-01-07T05:05:18.025ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2692025-01-07T05:05:18.035ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2702025-01-07T05:05:18.035ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool)
2712025-01-07T05:05:18.076ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/probe_manager.rs:231 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2722025-01-07T05:05:18.133ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }
2732025-01-07T05:05:18.142ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2742025-01-07T05:05:18.142ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2752025-01-07T05:05:18.142ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2762025-01-07T05:05:18.142ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2772025-01-07T05:05:18.142ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2782025-01-07T05:05:18.142ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2792025-01-07T05:05:18.142ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2802025-01-07T05:05:18.178ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.367968184s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
2812025-01-07T05:05:18.180ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2822025-01-07T05:05:18.188ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone file = sled-storage/src/dataset.rs:302
2832025-01-07T05:05:18.329ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5bbe57c7-cdff-41cb-8e81-937c370da161 file = sled-storage/src/dataset.rs:388
2842025-01-07T05:05:18.337ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2852025-01-07T05:05:18.337ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2862025-01-07T05:05:18.337ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2872025-01-07T05:05:18.337ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2882025-01-07T05:05:18.337ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2892025-01-07T05:05:18.347ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2902025-01-07T05:05:18.347ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool)
2912025-01-07T05:05:18.438ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }
2922025-01-07T05:05:18.445ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2932025-01-07T05:05:18.445ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2942025-01-07T05:05:18.445ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2952025-01-07T05:05:18.445ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2962025-01-07T05:05:18.445ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2972025-01-07T05:05:18.445ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2982025-01-07T05:05:18.445ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2992025-01-07T05:05:18.478ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3002025-01-07T05:05:18.485ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone file = sled-storage/src/dataset.rs:302
3012025-01-07T05:05:18.615ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5 file = sled-storage/src/dataset.rs:388
3022025-01-07T05:05:18.622ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3032025-01-07T05:05:18.623ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3042025-01-07T05:05:18.623ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3052025-01-07T05:05:18.623ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3062025-01-07T05:05:18.623ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3072025-01-07T05:05:18.632ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3082025-01-07T05:05:18.632ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9ec06319-8348-4c49-b606-b9eed234158a (zpool)
3092025-01-07T05:05:18.728ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }
3102025-01-07T05:05:18.736ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3112025-01-07T05:05:18.736ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3122025-01-07T05:05:18.736ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3132025-01-07T05:05:18.736ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3142025-01-07T05:05:18.736ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3152025-01-07T05:05:18.736ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3162025-01-07T05:05:18.736ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3172025-01-07T05:05:18.771ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3182025-01-07T05:05:18.779ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone file = sled-storage/src/dataset.rs:302
3192025-01-07T05:05:18.918ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9ec06319-8348-4c49-b606-b9eed234158a file = sled-storage/src/dataset.rs:388
3202025-01-07T05:05:18.926ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3212025-01-07T05:05:18.926ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3222025-01-07T05:05:18.926ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3232025-01-07T05:05:18.926ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3242025-01-07T05:05:18.926ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3252025-01-07T05:05:18.936ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3262025-01-07T05:05:18.936ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool)
3272025-01-07T05:05:19.034ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }
3282025-01-07T05:05:19.042ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3292025-01-07T05:05:19.042ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3302025-01-07T05:05:19.042ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3312025-01-07T05:05:19.042ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3322025-01-07T05:05:19.042ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3332025-01-07T05:05:19.042ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3342025-01-07T05:05:19.042ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3352025-01-07T05:05:19.076ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3362025-01-07T05:05:19.080ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/probe_manager.rs:231 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
3372025-01-07T05:05:19.084ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/zone file = sled-storage/src/dataset.rs:302
3382025-01-07T05:05:19.220ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4 file = sled-storage/src/dataset.rs:388
3392025-01-07T05:05:19.228ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3402025-01-07T05:05:19.228ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3412025-01-07T05:05:19.228ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3422025-01-07T05:05:19.228ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3432025-01-07T05:05:19.228ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3442025-01-07T05:05:19.238ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3452025-01-07T05:05:19.238ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool)
3462025-01-07T05:05:19.336ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }
3472025-01-07T05:05:19.344ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3482025-01-07T05:05:19.344ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3492025-01-07T05:05:19.344ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3502025-01-07T05:05:19.344ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3512025-01-07T05:05:19.344ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3522025-01-07T05:05:19.344ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3532025-01-07T05:05:19.344ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3542025-01-07T05:05:19.378ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3552025-01-07T05:05:19.386ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone file = sled-storage/src/dataset.rs:302
3562025-01-07T05:05:19.531ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fb670df5-eb06-4537-8ba0-b5be2520f226 file = sled-storage/src/dataset.rs:388
3572025-01-07T05:05:19.539ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3582025-01-07T05:05:19.539ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3592025-01-07T05:05:19.539ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3602025-01-07T05:05:19.539ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3612025-01-07T05:05:19.539ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3622025-01-07T05:05:19.550ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3632025-01-07T05:05:19.550ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool)
3642025-01-07T05:05:19.646ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }
3652025-01-07T05:05:19.654ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3662025-01-07T05:05:19.654ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3672025-01-07T05:05:19.654ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3682025-01-07T05:05:19.654ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3692025-01-07T05:05:19.654ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3702025-01-07T05:05:19.654ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3712025-01-07T05:05:19.654ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3722025-01-07T05:05:19.688ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3732025-01-07T05:05:19.696ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crypt/zone file = sled-storage/src/dataset.rs:302
3742025-01-07T05:05:19.835ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f file = sled-storage/src/dataset.rs:388
3752025-01-07T05:05:19.843ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3762025-01-07T05:05:19.843ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3772025-01-07T05:05:19.843ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3782025-01-07T05:05:19.843ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3792025-01-07T05:05:19.843ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3802025-01-07T05:05:19.853ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3812025-01-07T05:05:19.853ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = feb9b757-126c-48f6-9509-1209dc404e30 (zpool)
3822025-01-07T05:05:19.952ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }
3832025-01-07T05:05:19.960ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3842025-01-07T05:05:19.960ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3852025-01-07T05:05:19.960ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3862025-01-07T05:05:19.960ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3872025-01-07T05:05:19.960ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3882025-01-07T05:05:19.960ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3892025-01-07T05:05:19.960ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3902025-01-07T05:05:19.995ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3912025-01-07T05:05:20.003ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_feb9b757-126c-48f6-9509-1209dc404e30/crypt/zone file = sled-storage/src/dataset.rs:302
3922025-01-07T05:05:20.082ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/probe_manager.rs:231 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
3932025-01-07T05:05:20.146ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_feb9b757-126c-48f6-9509-1209dc404e30 file = sled-storage/src/dataset.rs:388
3942025-01-07T05:05:20.153ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3952025-01-07T05:05:20.153ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3962025-01-07T05:05:20.153ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3972025-01-07T05:05:20.153ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3982025-01-07T05:05:20.153ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3992025-01-07T05:05:20.163ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4002025-01-07T05:05:20.163ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool)
4012025-01-07T05:05:20.258ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }
4022025-01-07T05:05:20.266ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4032025-01-07T05:05:20.266ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4042025-01-07T05:05:20.266ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4052025-01-07T05:05:20.266ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4062025-01-07T05:05:20.266ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4072025-01-07T05:05:20.266ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4082025-01-07T05:05:20.266ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4092025-01-07T05:05:20.301ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4102025-01-07T05:05:20.309ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/zone file = sled-storage/src/dataset.rs:302
4112025-01-07T05:05:20.448ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 file = sled-storage/src/dataset.rs:388
4122025-01-07T05:05:20.455ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4132025-01-07T05:05:20.455ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4142025-01-07T05:05:20.455ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4152025-01-07T05:05:20.455ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4162025-01-07T05:05:20.455ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4172025-01-07T05:05:20.465ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4182025-01-07T05:05:20.465ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool)
4192025-01-07T05:05:20.559ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }
4202025-01-07T05:05:20.569ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4212025-01-07T05:05:20.569ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4222025-01-07T05:05:20.569ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4232025-01-07T05:05:20.569ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4242025-01-07T05:05:20.569ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4252025-01-07T05:05:20.570ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4262025-01-07T05:05:20.570ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4272025-01-07T05:05:20.605ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4282025-01-07T05:05:20.613ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone file = sled-storage/src/dataset.rs:302
4292025-01-07T05:05:20.773ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c file = sled-storage/src/dataset.rs:388
4302025-01-07T05:05:20.785ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4312025-01-07T05:05:20.785ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4322025-01-07T05:05:20.785ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332025-01-07T05:05:20.785ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0903eba0-a42b-4f15-a659-5669cab98e49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4342025-01-07T05:05:20.785ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4352025-01-07T05:05:20.785ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4362025-01-07T05:05:20.785ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4372025-01-07T05:05:20.786ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4382025-01-07T05:05:20.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4392025-01-07T05:05:20.786ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4402025-01-07T05:05:20.786ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4412025-01-07T05:05:20.786ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4422025-01-07T05:05:20.786ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4432025-01-07T05:05:20.786ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4442025-01-07T05:05:20.786ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4452025-01-07T05:05:20.786ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4462025-01-07T05:05:20.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2761145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52777 req_id = d269d618-f105-41c9-882e-c0e470eff3cb response_code = 200 uri = /omicron-physical-disks
4472025-01-07T05:05:20.817ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0108cb8f-edd0-4d41-8a49-80f33ee2b1b9 (dataset): DatasetConfig { id: 0108cb8f-edd0-4d41-8a49-80f33ee2b1b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 019ab733-fb58-4f5b-b1fd-1794fa08885e (dataset): DatasetConfig { id: 019ab733-fb58-4f5b-b1fd-1794fa08885e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 038c6a9b-173e-461d-9d8d-30e902e7b662 (dataset): DatasetConfig { id: 038c6a9b-173e-461d-9d8d-30e902e7b662 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0aa59c32-8e16-4e65-a584-236054516112 (dataset): DatasetConfig { id: 0aa59c32-8e16-4e65-a584-236054516112 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0cc31542-cfe6-4411-9b15-901027e25816 (dataset): DatasetConfig { id: 0cc31542-cfe6-4411-9b15-901027e25816 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f823509-b1cb-4d57-9f43-a7e3a1a3fd70 (dataset): DatasetConfig { id: 0f823509-b1cb-4d57-9f43-a7e3a1a3fd70 (dataset), name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10017eb8-0c2f-4ee3-afcb-3a959b5bf321 (dataset): DatasetConfig { id: 10017eb8-0c2f-4ee3-afcb-3a959b5bf321 (dataset), name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e2e9274-2518-4a3c-9786-549cc03c6a0f (dataset): DatasetConfig { id: 1e2e9274-2518-4a3c-9786-549cc03c6a0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 219e67d0-a47a-4cb5-8e36-31fde7a69df1 (dataset): DatasetConfig { id: 219e67d0-a47a-4cb5-8e36-31fde7a69df1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 255bba52-928a-47c3-90e6-e16b6bf877e2 (dataset): DatasetConfig { id: 255bba52-928a-47c3-90e6-e16b6bf877e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29bee844-c046-4d7b-9e32-e6c730104fad (dataset): DatasetConfig { id: 29bee844-c046-4d7b-9e32-e6c730104fad (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d79cce5-3d03-4cec-9333-8af6e66368b8 (dataset): DatasetConfig { id: 2d79cce5-3d03-4cec-9333-8af6e66368b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e2466e6-cf0a-4543-8dcb-319df497f8f1 (dataset): DatasetConfig { id: 2e2466e6-cf0a-4543-8dcb-319df497f8f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fe99a35-a9e6-4f73-a686-ac4400319430 (dataset): DatasetConfig { id: 2fe99a35-a9e6-4f73-a686-ac4400319430 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe22bb-b193-451c-8a98-dbe142e5da95 (dataset): DatasetConfig { id: 30fe22bb-b193-451c-8a98-dbe142e5da95 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 333c5104-73f6-4d95-814a-b53ecf8bc547 (dataset): DatasetConfig { id: 333c5104-73f6-4d95-814a-b53ecf8bc547 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 372f2366-e358-4199-b1b7-d6b5b360747b (dataset): DatasetConfig { id: 372f2366-e358-4199-b1b7-d6b5b360747b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39abcfab-bb11-4973-94aa-bd04a0cf7517 (dataset): DatasetConfig { id: 39abcfab-bb11-4973-94aa-bd04a0cf7517 (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a1e166b-7864-4a89-9f76-a98bd8e23c55 (dataset): DatasetConfig { id: 3a1e166b-7864-4a89-9f76-a98bd8e23c55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f6a08eb-f6c7-458c-97a2-16096d980f7d (dataset): DatasetConfig { id: 3f6a08eb-f6c7-458c-97a2-16096d980f7d (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 41e8286d-ebaf-4b2e-b8d0-fb8981d1727e (dataset): DatasetConfig { id: 41e8286d-ebaf-4b2e-b8d0-fb8981d1727e (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43e7c206-b11b-4f79-8100-7329476407d8 (dataset): DatasetConfig { id: 43e7c206-b11b-4f79-8100-7329476407d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5135f9f3-2641-4e0a-8918-3f7a0c848524 (dataset): DatasetConfig { id: 5135f9f3-2641-4e0a-8918-3f7a0c848524 (dataset), name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54b12ea9-402a-44e6-8378-db03a1a2cdf6 (dataset): DatasetConfig { id: 54b12ea9-402a-44e6-8378-db03a1a2cdf6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55fde94e-9398-46f2-a9f2-04f4c0a1ce27 (dataset): DatasetConfig { id: 55fde94e-9398-46f2-a9f2-04f4c0a1ce27 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5957d622-3f74-4a95-bfac-3da29b555741 (dataset): DatasetConfig { id: 5957d622-3f74-4a95-bfac-3da29b555741 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5abe5841-1be6-4413-a4cc-8114b71cc01f (dataset): DatasetConfig { id: 5abe5841-1be6-4413-a4cc-8114b71cc01f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fe523a8-2e8f-4a70-b248-3d99593650ac (dataset): DatasetConfig { id: 5fe523a8-2e8f-4a70-b248-3d99593650ac (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61319073-bbed-421a-8d8c-d1bd49c9cfcb (dataset): DatasetConfig { id: 61319073-bbed-421a-8d8c-d1bd49c9cfcb (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 63ea641d-5bb6-48b1-b6f1-b75f003b0c95 (dataset): DatasetConfig { id: 63ea641d-5bb6-48b1-b6f1-b75f003b0c95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65f702e1-f93c-40ad-937d-99b15f22c241 (dataset): DatasetConfig { id: 65f702e1-f93c-40ad-937d-99b15f22c241 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 67128fa2-84ce-4855-b40f-d83e1a276d2e (dataset): DatasetConfig { id: 67128fa2-84ce-4855-b40f-d83e1a276d2e (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 708e1b0b-df63-4f82-ae63-63f8894381aa (dataset): DatasetConfig { id: 708e1b0b-df63-4f82-ae63-63f8894381aa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71aea0f2-37e1-4f0d-b864-160c74b2d138 (dataset): DatasetConfig { id: 71aea0f2-37e1-4f0d-b864-160c74b2d138 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72c727f0-7eed-40ac-9a23-aebaa760ee48 (dataset): DatasetConfig { id: 72c727f0-7eed-40ac-9a23-aebaa760ee48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72f67224-ff77-47b6-8b9f-4e5461fa0acd (dataset): DatasetConfig { id: 72f67224-ff77-47b6-8b9f-4e5461fa0acd (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 797e0ae6-8a63-4ce9-aeb2-a8997800598d (dataset): DatasetConfig { id: 797e0ae6-8a63-4ce9-aeb2-a8997800598d (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ac1315d-901b-4010-8c73-c63fe40bbebe (dataset): DatasetConfig { id: 7ac1315d-901b-4010-8c73-c63fe40bbebe (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cf33c62-7017-47b4-a3c0-d5aedab49f22 (dataset): DatasetConfig { id: 7cf33c62-7017-47b4-a3c0-d5aedab49f22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8158f6fb-83de-4704-ae71-18f16468c719 (dataset): DatasetConfig { id: 8158f6fb-83de-4704-ae71-18f16468c719 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86a5c178-08b1-45d5-b7ec-4dbe3a1a72d9 (dataset): DatasetConfig { id: 86a5c178-08b1-45d5-b7ec-4dbe3a1a72d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88c07fd7-0c2b-45a6-a5de-c2ce329ead6d (dataset): DatasetConfig { id: 88c07fd7-0c2b-45a6-a5de-c2ce329ead6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9901cb84-83b4-4596-be81-5f8a36598162 (dataset): DatasetConfig { id: 9901cb84-83b4-4596-be81-5f8a36598162 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99f6a587-fc6c-4fb5-a6ce-3ff0be10caf7 (dataset): DatasetConfig { id: 99f6a587-fc6c-4fb5-a6ce-3ff0be10caf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9bf03c28-38a3-47e4-bfac-6a0f9d64e131 (dataset): DatasetConfig { id: 9bf03c28-38a3-47e4-bfac-6a0f9d64e131 (dataset), name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a22fe571-d12b-42ef-98d5-39a224b5857d (dataset): DatasetConfig { id: a22fe571-d12b-42ef-98d5-39a224b5857d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7392ab6-cb7f-4da5-8d1f-7fcda636ac11 (dataset): DatasetConfig { id: a7392ab6-cb7f-4da5-8d1f-7fcda636ac11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a77ea0c5-f517-4353-81d7-c2e215f5b39b (dataset): DatasetConfig { id: a77ea0c5-f517-4353-81d7-c2e215f5b39b (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac1b0f7e-d424-490e-844e-b5f0a4a0154f (dataset): DatasetConfig { id: ac1b0f7e-d424-490e-844e-b5f0a4a0154f (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac5c61c7-edf8-42cf-af4b-590f5e2722c5 (dataset): DatasetConfig { id: ac5c61c7-edf8-42cf-af4b-590f5e2722c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b43994fe-55e7-4e27-926d-1c10a56282c0 (dataset): DatasetConfig { id: b43994fe-55e7-4e27-926d-1c10a56282c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7096abf-b9ef-4f08-bcb7-da164c162a6c (dataset): DatasetConfig { id: b7096abf-b9ef-4f08-bcb7-da164c162a6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7b28daa-7652-4051-8cfd-c338b201ece0 (dataset): DatasetConfig { id: b7b28daa-7652-4051-8cfd-c338b201ece0 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba93435b-6729-4cb0-b0c5-0592b4dd1827 (dataset): DatasetConfig { id: ba93435b-6729-4cb0-b0c5-0592b4dd1827 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c174d455-36c2-4b01-87fd-9b643ae4f0dc (dataset): DatasetConfig { id: c174d455-36c2-4b01-87fd-9b643ae4f0dc (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c31f4aff-ecc5-4b8f-bdeb-ddc5916a2e50 (dataset): DatasetConfig { id: c31f4aff-ecc5-4b8f-bdeb-ddc5916a2e50 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c8c390ba-140e-498a-b7a3-2e40d7bb5c36 (dataset): DatasetConfig { id: c8c390ba-140e-498a-b7a3-2e40d7bb5c36 (dataset), name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, caa44c81-c7f5-40b0-910e-b84d967711b6 (dataset): DatasetConfig { id: caa44c81-c7f5-40b0-910e-b84d967711b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d39a1a72-bc6b-4088-a3b8-319b0636982a (dataset): DatasetConfig { id: d39a1a72-bc6b-4088-a3b8-319b0636982a (dataset), name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d55efa44-f2e6-4a40-8c7e-99085e66510d (dataset): DatasetConfig { id: d55efa44-f2e6-4a40-8c7e-99085e66510d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6876b48-e528-4e8a-8a5a-75b8c806df91 (dataset): DatasetConfig { id: d6876b48-e528-4e8a-8a5a-75b8c806df91 (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e54d00aa-c6c3-47a9-8959-9afaad2441a2 (dataset): DatasetConfig { id: e54d00aa-c6c3-47a9-8959-9afaad2441a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7d26bc5-55f9-423d-9f29-30b45f7b8538 (dataset): DatasetConfig { id: e7d26bc5-55f9-423d-9f29-30b45f7b8538 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee7a65a8-0bd8-438f-9945-d9cb038aece0 (dataset): DatasetConfig { id: ee7a65a8-0bd8-438f-9945-d9cb038aece0 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef71a653-791b-43ca-9397-0d7160a4f74e (dataset): DatasetConfig { id: ef71a653-791b-43ca-9397-0d7160a4f74e (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4debda8-1037-4880-b76c-4d54a40d3c1f (dataset): DatasetConfig { id: f4debda8-1037-4880-b76c-4d54a40d3c1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4482025-01-07T05:05:20.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48362
4492025-01-07T05:05:20.818ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4502025-01-07T05:05:20.818ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0108cb8f-edd0-4d41-8a49-80f33ee2b1b9 (dataset): DatasetConfig { id: 0108cb8f-edd0-4d41-8a49-80f33ee2b1b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 019ab733-fb58-4f5b-b1fd-1794fa08885e (dataset): DatasetConfig { id: 019ab733-fb58-4f5b-b1fd-1794fa08885e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 038c6a9b-173e-461d-9d8d-30e902e7b662 (dataset): DatasetConfig { id: 038c6a9b-173e-461d-9d8d-30e902e7b662 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0aa59c32-8e16-4e65-a584-236054516112 (dataset): DatasetConfig { id: 0aa59c32-8e16-4e65-a584-236054516112 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0cc31542-cfe6-4411-9b15-901027e25816 (dataset): DatasetConfig { id: 0cc31542-cfe6-4411-9b15-901027e25816 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f823509-b1cb-4d57-9f43-a7e3a1a3fd70 (dataset): DatasetConfig { id: 0f823509-b1cb-4d57-9f43-a7e3a1a3fd70 (dataset), name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10017eb8-0c2f-4ee3-afcb-3a959b5bf321 (dataset): DatasetConfig { id: 10017eb8-0c2f-4ee3-afcb-3a959b5bf321 (dataset), name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e2e9274-2518-4a3c-9786-549cc03c6a0f (dataset): DatasetConfig { id: 1e2e9274-2518-4a3c-9786-549cc03c6a0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 219e67d0-a47a-4cb5-8e36-31fde7a69df1 (dataset): DatasetConfig { id: 219e67d0-a47a-4cb5-8e36-31fde7a69df1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 255bba52-928a-47c3-90e6-e16b6bf877e2 (dataset): DatasetConfig { id: 255bba52-928a-47c3-90e6-e16b6bf877e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29bee844-c046-4d7b-9e32-e6c730104fad (dataset): DatasetConfig { id: 29bee844-c046-4d7b-9e32-e6c730104fad (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d79cce5-3d03-4cec-9333-8af6e66368b8 (dataset): DatasetConfig { id: 2d79cce5-3d03-4cec-9333-8af6e66368b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e2466e6-cf0a-4543-8dcb-319df497f8f1 (dataset): DatasetConfig { id: 2e2466e6-cf0a-4543-8dcb-319df497f8f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fe99a35-a9e6-4f73-a686-ac4400319430 (dataset): DatasetConfig { id: 2fe99a35-a9e6-4f73-a686-ac4400319430 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe22bb-b193-451c-8a98-dbe142e5da95 (dataset): DatasetConfig { id: 30fe22bb-b193-451c-8a98-dbe142e5da95 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 333c5104-73f6-4d95-814a-b53ecf8bc547 (dataset): DatasetConfig { id: 333c5104-73f6-4d95-814a-b53ecf8bc547 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 372f2366-e358-4199-b1b7-d6b5b360747b (dataset): DatasetConfig { id: 372f2366-e358-4199-b1b7-d6b5b360747b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39abcfab-bb11-4973-94aa-bd04a0cf7517 (dataset): DatasetConfig { id: 39abcfab-bb11-4973-94aa-bd04a0cf7517 (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a1e166b-7864-4a89-9f76-a98bd8e23c55 (dataset): DatasetConfig { id: 3a1e166b-7864-4a89-9f76-a98bd8e23c55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f6a08eb-f6c7-458c-97a2-16096d980f7d (dataset): DatasetConfig { id: 3f6a08eb-f6c7-458c-97a2-16096d980f7d (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 41e8286d-ebaf-4b2e-b8d0-fb8981d1727e (dataset): DatasetConfig { id: 41e8286d-ebaf-4b2e-b8d0-fb8981d1727e (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43e7c206-b11b-4f79-8100-7329476407d8 (dataset): DatasetConfig { id: 43e7c206-b11b-4f79-8100-7329476407d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5135f9f3-2641-4e0a-8918-3f7a0c848524 (dataset): DatasetConfig { id: 5135f9f3-2641-4e0a-8918-3f7a0c848524 (dataset), name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54b12ea9-402a-44e6-8378-db03a1a2cdf6 (dataset): DatasetConfig { id: 54b12ea9-402a-44e6-8378-db03a1a2cdf6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55fde94e-9398-46f2-a9f2-04f4c0a1ce27 (dataset): DatasetConfig { id: 55fde94e-9398-46f2-a9f2-04f4c0a1ce27 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5957d622-3f74-4a95-bfac-3da29b555741 (dataset): DatasetConfig { id: 5957d622-3f74-4a95-bfac-3da29b555741 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5abe5841-1be6-4413-a4cc-8114b71cc01f (dataset): DatasetConfig { id: 5abe5841-1be6-4413-a4cc-8114b71cc01f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fe523a8-2e8f-4a70-b248-3d99593650ac (dataset): DatasetConfig { id: 5fe523a8-2e8f-4a70-b248-3d99593650ac (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61319073-bbed-421a-8d8c-d1bd49c9cfcb (dataset): DatasetConfig { id: 61319073-bbed-421a-8d8c-d1bd49c9cfcb (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 63ea641d-5bb6-48b1-b6f1-b75f003b0c95 (dataset): DatasetConfig { id: 63ea641d-5bb6-48b1-b6f1-b75f003b0c95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65f702e1-f93c-40ad-937d-99b15f22c241 (dataset): DatasetConfig { id: 65f702e1-f93c-40ad-937d-99b15f22c241 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 67128fa2-84ce-4855-b40f-d83e1a276d2e (dataset): DatasetConfig { id: 67128fa2-84ce-4855-b40f-d83e1a276d2e (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 708e1b0b-df63-4f82-ae63-63f8894381aa (dataset): DatasetConfig { id: 708e1b0b-df63-4f82-ae63-63f8894381aa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71aea0f2-37e1-4f0d-b864-160c74b2d138 (dataset): DatasetConfig { id: 71aea0f2-37e1-4f0d-b864-160c74b2d138 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72c727f0-7eed-40ac-9a23-aebaa760ee48 (dataset): DatasetConfig { id: 72c727f0-7eed-40ac-9a23-aebaa760ee48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72f67224-ff77-47b6-8b9f-4e5461fa0acd (dataset): DatasetConfig { id: 72f67224-ff77-47b6-8b9f-4e5461fa0acd (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 797e0ae6-8a63-4ce9-aeb2-a8997800598d (dataset): DatasetConfig { id: 797e0ae6-8a63-4ce9-aeb2-a8997800598d (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ac1315d-901b-4010-8c73-c63fe40bbebe (dataset): DatasetConfig { id: 7ac1315d-901b-4010-8c73-c63fe40bbebe (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cf33c62-7017-47b4-a3c0-d5aedab49f22 (dataset): DatasetConfig { id: 7cf33c62-7017-47b4-a3c0-d5aedab49f22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8158f6fb-83de-4704-ae71-18f16468c719 (dataset): DatasetConfig { id: 8158f6fb-83de-4704-ae71-18f16468c719 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86a5c178-08b1-45d5-b7ec-4dbe3a1a72d9 (dataset): DatasetConfig { id: 86a5c178-08b1-45d5-b7ec-4dbe3a1a72d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88c07fd7-0c2b-45a6-a5de-c2ce329ead6d (dataset): DatasetConfig { id: 88c07fd7-0c2b-45a6-a5de-c2ce329ead6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9901cb84-83b4-4596-be81-5f8a36598162 (dataset): DatasetConfig { id: 9901cb84-83b4-4596-be81-5f8a36598162 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99f6a587-fc6c-4fb5-a6ce-3ff0be10caf7 (dataset): DatasetConfig { id: 99f6a587-fc6c-4fb5-a6ce-3ff0be10caf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9bf03c28-38a3-47e4-bfac-6a0f9d64e131 (dataset): DatasetConfig { id: 9bf03c28-38a3-47e4-bfac-6a0f9d64e131 (dataset), name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a22fe571-d12b-42ef-98d5-39a224b5857d (dataset): DatasetConfig { id: a22fe571-d12b-42ef-98d5-39a224b5857d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7392ab6-cb7f-4da5-8d1f-7fcda636ac11 (dataset): DatasetConfig { id: a7392ab6-cb7f-4da5-8d1f-7fcda636ac11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a77ea0c5-f517-4353-81d7-c2e215f5b39b (dataset): DatasetConfig { id: a77ea0c5-f517-4353-81d7-c2e215f5b39b (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac1b0f7e-d424-490e-844e-b5f0a4a0154f (dataset): DatasetConfig { id: ac1b0f7e-d424-490e-844e-b5f0a4a0154f (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac5c61c7-edf8-42cf-af4b-590f5e2722c5 (dataset): DatasetConfig { id: ac5c61c7-edf8-42cf-af4b-590f5e2722c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b43994fe-55e7-4e27-926d-1c10a56282c0 (dataset): DatasetConfig { id: b43994fe-55e7-4e27-926d-1c10a56282c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7096abf-b9ef-4f08-bcb7-da164c162a6c (dataset): DatasetConfig { id: b7096abf-b9ef-4f08-bcb7-da164c162a6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7b28daa-7652-4051-8cfd-c338b201ece0 (dataset): DatasetConfig { id: b7b28daa-7652-4051-8cfd-c338b201ece0 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba93435b-6729-4cb0-b0c5-0592b4dd1827 (dataset): DatasetConfig { id: ba93435b-6729-4cb0-b0c5-0592b4dd1827 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c174d455-36c2-4b01-87fd-9b643ae4f0dc (dataset): DatasetConfig { id: c174d455-36c2-4b01-87fd-9b643ae4f0dc (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c31f4aff-ecc5-4b8f-bdeb-ddc5916a2e50 (dataset): DatasetConfig { id: c31f4aff-ecc5-4b8f-bdeb-ddc5916a2e50 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c8c390ba-140e-498a-b7a3-2e40d7bb5c36 (dataset): DatasetConfig { id: c8c390ba-140e-498a-b7a3-2e40d7bb5c36 (dataset), name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, caa44c81-c7f5-40b0-910e-b84d967711b6 (dataset): DatasetConfig { id: caa44c81-c7f5-40b0-910e-b84d967711b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d39a1a72-bc6b-4088-a3b8-319b0636982a (dataset): DatasetConfig { id: d39a1a72-bc6b-4088-a3b8-319b0636982a (dataset), name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d55efa44-f2e6-4a40-8c7e-99085e66510d (dataset): DatasetConfig { id: d55efa44-f2e6-4a40-8c7e-99085e66510d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6876b48-e528-4e8a-8a5a-75b8c806df91 (dataset): DatasetConfig { id: d6876b48-e528-4e8a-8a5a-75b8c806df91 (dataset), name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e54d00aa-c6c3-47a9-8959-9afaad2441a2 (dataset): DatasetConfig { id: e54d00aa-c6c3-47a9-8959-9afaad2441a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7d26bc5-55f9-423d-9f29-30b45f7b8538 (dataset): DatasetConfig { id: e7d26bc5-55f9-423d-9f29-30b45f7b8538 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee7a65a8-0bd8-438f-9945-d9cb038aece0 (dataset): DatasetConfig { id: ee7a65a8-0bd8-438f-9945-d9cb038aece0 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef71a653-791b-43ca-9397-0d7160a4f74e (dataset): DatasetConfig { id: ef71a653-791b-43ca-9397-0d7160a4f74e (dataset), name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4debda8-1037-4880-b76c-4d54a40d3c1f (dataset): DatasetConfig { id: f4debda8-1037-4880-b76c-4d54a40d3c1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4512025-01-07T05:05:20.818ZINFOSledAgent (StorageManager): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4522025-01-07T05:05:20.818ZINFOSledAgent (StorageManager): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4532025-01-07T05:05:20.818ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4542025-01-07T05:05:20.833ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-01-07T05:05:20.833ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4562025-01-07T05:05:20.833ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone/oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone/oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c" } file = sled-storage/src/manager.rs:1431
4572025-01-07T05:05:20.895ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-01-07T05:05:20.895ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592025-01-07T05:05:20.895ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4602025-01-07T05:05:20.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-01-07T05:05:20.943ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4622025-01-07T05:05:20.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone/oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone/oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85" } file = sled-storage/src/manager.rs:1431
4632025-01-07T05:05:21.002ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-01-07T05:05:21.002ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652025-01-07T05:05:21.002ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5" } file = sled-storage/src/manager.rs:1431
4662025-01-07T05:05:21.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-01-07T05:05:21.059ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682025-01-07T05:05:21.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692" } file = sled-storage/src/manager.rs:1431
4692025-01-07T05:05:21.084ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/probe_manager.rs:231 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
4702025-01-07T05:05:21.117ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-07T05:05:21.117ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-01-07T05:05:21.117ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_feb9b757-126c-48f6-9509-1209dc404e30/crucible" } file = sled-storage/src/manager.rs:1431
4732025-01-07T05:05:21.165ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-07T05:05:21.165ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4752025-01-07T05:05:21.165ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crypt/zone"), full_name: "oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crypt/zone" } file = sled-storage/src/manager.rs:1431
4762025-01-07T05:05:21.194ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-07T05:05:21.194ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-07T05:05:21.194ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone/oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone/oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831" } file = sled-storage/src/manager.rs:1431
4792025-01-07T05:05:21.251ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-07T05:05:21.251ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-01-07T05:05:21.251ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone/oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone/oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c" } file = sled-storage/src/manager.rs:1431
4822025-01-07T05:05:21.308ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-07T05:05:21.308ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842025-01-07T05:05:21.308ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone/oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone/oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495" } file = sled-storage/src/manager.rs:1431
4852025-01-07T05:05:21.369ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-01-07T05:05:21.369ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4872025-01-07T05:05:21.369ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/debug"), full_name: "oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/debug" } file = sled-storage/src/manager.rs:1431
4882025-01-07T05:05:21.397ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-01-07T05:05:21.397ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-01-07T05:05:21.397ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405" } file = sled-storage/src/manager.rs:1431
4912025-01-07T05:05:21.458ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-01-07T05:05:21.458ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932025-01-07T05:05:21.458ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone/oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06"), full_name: "oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone/oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06" } file = sled-storage/src/manager.rs:1431
4942025-01-07T05:05:21.516ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-01-07T05:05:21.516ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-01-07T05:05:21.516ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0" } file = sled-storage/src/manager.rs:1431
4972025-01-07T05:05:21.575ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-01-07T05:05:21.575ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992025-01-07T05:05:21.575ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312" } file = sled-storage/src/manager.rs:1431
5002025-01-07T05:05:21.634ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-01-07T05:05:21.634ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022025-01-07T05:05:21.634ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crucible" } file = sled-storage/src/manager.rs:1431
5032025-01-07T05:05:21.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-07T05:05:21.680ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-01-07T05:05:21.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482" } file = sled-storage/src/manager.rs:1431
5062025-01-07T05:05:21.740ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-07T05:05:21.740ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-01-07T05:05:21.740ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crucible" } file = sled-storage/src/manager.rs:1431
5092025-01-07T05:05:21.789ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-07T05:05:21.789ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-01-07T05:05:21.789ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5122025-01-07T05:05:21.837ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-01-07T05:05:21.837ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5142025-01-07T05:05:21.837ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/debug"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/debug" } file = sled-storage/src/manager.rs:1431
5152025-01-07T05:05:21.866ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-01-07T05:05:21.866ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5172025-01-07T05:05:21.866ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone" } file = sled-storage/src/manager.rs:1431
5182025-01-07T05:05:21.894ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-01-07T05:05:21.894ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5202025-01-07T05:05:21.894ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/zone"), full_name: "oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/zone" } file = sled-storage/src/manager.rs:1431
5212025-01-07T05:05:21.923ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-01-07T05:05:21.923ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5232025-01-07T05:05:21.923ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/feb9b757-126c-48f6-9509-1209dc404e30/crypt/zone"), full_name: "oxp_feb9b757-126c-48f6-9509-1209dc404e30/crypt/zone" } file = sled-storage/src/manager.rs:1431
5242025-01-07T05:05:21.951ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-01-07T05:05:21.951ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262025-01-07T05:05:21.951ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5272025-01-07T05:05:21.999ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282025-01-07T05:05:21.999ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5292025-01-07T05:05:21.999ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone" } file = sled-storage/src/manager.rs:1431
5302025-01-07T05:05:22.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312025-01-07T05:05:22.028ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5322025-01-07T05:05:22.028ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1" } file = sled-storage/src/manager.rs:1431
5332025-01-07T05:05:22.086ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/probe_manager.rs:231 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
5342025-01-07T05:05:22.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-07T05:05:22.092ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-01-07T05:05:22.092ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone/oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone/oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b" } file = sled-storage/src/manager.rs:1431
5372025-01-07T05:05:22.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-07T05:05:22.156ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5392025-01-07T05:05:22.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone"), full_name: "oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5402025-01-07T05:05:22.186ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-07T05:05:22.186ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5422025-01-07T05:05:22.186ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/debug"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/debug" } file = sled-storage/src/manager.rs:1431
5432025-01-07T05:05:22.216ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-07T05:05:22.216ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5452025-01-07T05:05:22.216ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5462025-01-07T05:05:22.246ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-01-07T05:05:22.246ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5482025-01-07T05:05:22.246ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/zone"), full_name: "oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/zone" } file = sled-storage/src/manager.rs:1431
5492025-01-07T05:05:22.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-01-07T05:05:22.276ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-01-07T05:05:22.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone/oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone/oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9" } file = sled-storage/src/manager.rs:1431
5522025-01-07T05:05:22.337ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-01-07T05:05:22.337ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542025-01-07T05:05:22.337ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5552025-01-07T05:05:22.388ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-01-07T05:05:22.388ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572025-01-07T05:05:22.388ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crucible" } file = sled-storage/src/manager.rs:1431
5582025-01-07T05:05:22.437ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-01-07T05:05:22.437ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-01-07T05:05:22.437ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5612025-01-07T05:05:22.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-01-07T05:05:22.485ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5632025-01-07T05:05:22.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/debug"), full_name: "oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/debug" } file = sled-storage/src/manager.rs:1431
5642025-01-07T05:05:22.515ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-01-07T05:05:22.515ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662025-01-07T05:05:22.515ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4" } file = sled-storage/src/manager.rs:1431
5672025-01-07T05:05:22.574ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-01-07T05:05:22.574ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692025-01-07T05:05:22.574ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5702025-01-07T05:05:22.623ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-01-07T05:05:22.623ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5722025-01-07T05:05:22.623ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5732025-01-07T05:05:22.673ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-01-07T05:05:22.673ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5752025-01-07T05:05:22.673ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/zone" } file = sled-storage/src/manager.rs:1431
5762025-01-07T05:05:22.704ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-01-07T05:05:22.704ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-01-07T05:05:22.704ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5792025-01-07T05:05:22.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-01-07T05:05:22.754ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812025-01-07T05:05:22.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443" } file = sled-storage/src/manager.rs:1431
5822025-01-07T05:05:22.814ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-01-07T05:05:22.814ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842025-01-07T05:05:22.814ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5852025-01-07T05:05:22.865ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-01-07T05:05:22.865ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872025-01-07T05:05:22.865ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone/oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f"), full_name: "oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone/oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f" } file = sled-storage/src/manager.rs:1431
5882025-01-07T05:05:22.924ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-01-07T05:05:22.924ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5902025-01-07T05:05:22.924ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/feb9b757-126c-48f6-9509-1209dc404e30/crypt/debug"), full_name: "oxp_feb9b757-126c-48f6-9509-1209dc404e30/crypt/debug" } file = sled-storage/src/manager.rs:1431
5912025-01-07T05:05:22.953ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-01-07T05:05:22.953ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932025-01-07T05:05:22.953ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crucible" } file = sled-storage/src/manager.rs:1431
5942025-01-07T05:05:23.002ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952025-01-07T05:05:23.002ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962025-01-07T05:05:23.002ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crucible" } file = sled-storage/src/manager.rs:1431
5972025-01-07T05:05:23.051ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982025-01-07T05:05:23.051ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992025-01-07T05:05:23.051ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/zone/oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18" } file = sled-storage/src/manager.rs:1431
6002025-01-07T05:05:23.091ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/probe_manager.rs:231 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
6012025-01-07T05:05:23.113ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-07T05:05:23.113ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6032025-01-07T05:05:23.113ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/zone/oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41"), full_name: "oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/zone/oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41" } file = sled-storage/src/manager.rs:1431
6042025-01-07T05:05:23.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-07T05:05:23.172ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6062025-01-07T05:05:23.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crypt/debug"), full_name: "oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crypt/debug" } file = sled-storage/src/manager.rs:1431
6072025-01-07T05:05:23.200ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-07T05:05:23.200ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-01-07T05:05:23.200ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crucible" } file = sled-storage/src/manager.rs:1431
6102025-01-07T05:05:23.250ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-01-07T05:05:23.250ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-01-07T05:05:23.250ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6132025-01-07T05:05:23.303ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-01-07T05:05:23.303ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-01-07T05:05:23.303ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/zone/oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d"), full_name: "oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/zone/oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d" } file = sled-storage/src/manager.rs:1431
6162025-01-07T05:05:23.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-01-07T05:05:23.363ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-01-07T05:05:23.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone/oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/zone/oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239" } file = sled-storage/src/manager.rs:1431
6192025-01-07T05:05:23.423ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-01-07T05:05:23.423ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6212025-01-07T05:05:23.423ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/debug"), full_name: "oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/debug" } file = sled-storage/src/manager.rs:1431
6222025-01-07T05:05:23.452ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-01-07T05:05:23.452ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6242025-01-07T05:05:23.452ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/debug"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/debug" } file = sled-storage/src/manager.rs:1431
6252025-01-07T05:05:23.481ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-01-07T05:05:23.481ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272025-01-07T05:05:23.481ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/feb9b757-126c-48f6-9509-1209dc404e30/crypt/zone/oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317"), full_name: "oxp_feb9b757-126c-48f6-9509-1209dc404e30/crypt/zone/oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317" } file = sled-storage/src/manager.rs:1431
6282025-01-07T05:05:23.542ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-01-07T05:05:23.542ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302025-01-07T05:05:23.542ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6312025-01-07T05:05:23.593ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-01-07T05:05:23.593ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332025-01-07T05:05:23.593ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crypt/zone/oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899"), full_name: "oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crypt/zone/oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899" } file = sled-storage/src/manager.rs:1431
6342025-01-07T05:05:23.652ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-07T05:05:23.652ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-01-07T05:05:23.652ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be"), full_name: "oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/zone/oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be" } file = sled-storage/src/manager.rs:1431
6372025-01-07T05:05:23.714ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-07T05:05:23.714ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-01-07T05:05:23.714ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone/oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7"), full_name: "oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/zone/oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7" } file = sled-storage/src/manager.rs:1431
6402025-01-07T05:05:23.773ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-07T05:05:23.773ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-07T05:05:23.773ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/zone/oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0"), full_name: "oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/zone/oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0" } file = sled-storage/src/manager.rs:1431
6432025-01-07T05:05:23.835ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-01-07T05:05:23.835ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-01-07T05:05:23.835ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4/crucible" } file = sled-storage/src/manager.rs:1431
6462025-01-07T05:05:23.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-01-07T05:05:23.884ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482025-01-07T05:05:23.884ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/zone/oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5"), full_name: "oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/zone/oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5" } file = sled-storage/src/manager.rs:1431
6492025-01-07T05:05:23.945ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502025-01-07T05:05:23.945ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6512025-01-07T05:05:23.946ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crucible" } file = sled-storage/src/manager.rs:1431
6522025-01-07T05:05:23.995ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6532025-01-07T05:05:23.995ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6542025-01-07T05:05:23.995ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9ec06319-8348-4c49-b606-b9eed234158a/crypt/debug"), full_name: "oxp_9ec06319-8348-4c49-b606-b9eed234158a/crypt/debug" } file = sled-storage/src/manager.rs:1431
6552025-01-07T05:05:24.025ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6562025-01-07T05:05:24.025ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6572025-01-07T05:05:24.026ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
6582025-01-07T05:05:24.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3208251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48362 req_id = 74d15220-cbaf-4ffd-a458-dc7d89c93df9 response_code = 200 uri = /datasets
6592025-01-07T05:05:24.057ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 0299d0a6-05a4-400d-9b14-105f1fc11bd5 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a45303cc-cbbc-484d-9f40-52a4c1a9be3c (service), filesystem_pool: Some(ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 454062aa-b5b7-4eac-a959-109647163239 (service), filesystem_pool: Some(ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6602025-01-07T05:05:24.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41114
6612025-01-07T05:05:24.058ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-01-07T05:05:24.058ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-01-07T05:05:24.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642025-01-07T05:05:24.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652025-01-07T05:05:24.080ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6662025-01-07T05:05:24.080ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, responder: ... }
6672025-01-07T05:05:24.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-07T05:05:24.089ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:188
6692025-01-07T05:05:24.089ZINFOSledAgent (ServiceManager): No ledger in /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:188
6702025-01-07T05:05:24.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-07T05:05:24.096ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/probe_manager.rs:231 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
6722025-01-07T05:05:24.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6732025-01-07T05:05:24.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6742025-01-07T05:05:24.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6752025-01-07T05:05:24.187ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5 file = illumos-utils/src/zone.rs:325
6762025-01-07T05:05:24.191ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c file = illumos-utils/src/zone.rs:325
6772025-01-07T05:05:24.195ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239 file = illumos-utils/src/zone.rs:325
6782025-01-07T05:05:24.206ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5 file = illumos-utils/src/zone.rs:363
6792025-01-07T05:05:24.210ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c file = illumos-utils/src/zone.rs:363
6802025-01-07T05:05:24.215ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239 file = illumos-utils/src/zone.rs:363
6812025-01-07T05:05:25.098ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed42aaef-618c-4920-bad3-c2a5ed2fd546) file = sled-agent/src/probe_manager.rs:231 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
6822025-01-07T05:05:25.798ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832025-01-07T05:05:25.798ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6842025-01-07T05:05:25.799ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
6852025-01-07T05:05:26.140ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
6862025-01-07T05:05:26.140ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
6872025-01-07T05:05:26.227ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
6882025-01-07T05:05:26.227ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
6892025-01-07T05:05:26.285ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6902025-01-07T05:05:26.293ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
6912025-01-07T05:05:26.293ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
6922025-01-07T05:05:26.318ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
6932025-01-07T05:05:26.319ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
6942025-01-07T05:05:26.390ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
6952025-01-07T05:05:26.390ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
6962025-01-07T05:05:26.478ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
6972025-01-07T05:05:26.478ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6982025-01-07T05:05:26.652ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 51.507624ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
6992025-01-07T05:05:26.704ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7002025-01-07T05:05:26.737ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7012025-01-07T05:05:26.737ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7022025-01-07T05:05:26.738ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7032025-01-07T05:05:26.738ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7042025-01-07T05:05:26.773ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7052025-01-07T05:05:26.773ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7062025-01-07T05:05:26.773ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7072025-01-07T05:05:26.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5") failed: Property not found. retry in 27.197463ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7082025-01-07T05:05:26.781ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7092025-01-07T05:05:26.786ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7102025-01-07T05:05:26.794ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7112025-01-07T05:05:26.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5") failed: Property not found. retry in 92.400376ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7122025-01-07T05:05:26.850ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7132025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7142025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7152025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7162025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7172025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7182025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7192025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7202025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7212025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7222025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7232025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7242025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7252025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7262025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7272025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7282025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7292025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7302025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7312025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7322025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7332025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7342025-01-07T05:05:26.851ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7352025-01-07T05:05:26.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239") failed: Property not found. retry in 40.753912ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7362025-01-07T05:05:26.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5") failed: Property not found. retry in 250.262737ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7372025-01-07T05:05:26.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 53.673719ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7382025-01-07T05:05:26.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239") failed: Property not found. retry in 120.066279ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7392025-01-07T05:05:27.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 88.919476ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7402025-01-07T05:05:27.057ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15291842851821954125 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
7412025-01-07T05:05:27.057ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10507353659874143342 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
7422025-01-07T05:05:27.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239") failed: Property not found. retry in 130.266599ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7432025-01-07T05:05:27.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 125.578209ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7442025-01-07T05:05:27.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5") failed: Property not found. retry in 359.179708ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7452025-01-07T05:05:27.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239") failed: Property not found. retry in 406.129823ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7462025-01-07T05:05:27.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 436.415918ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7472025-01-07T05:05:27.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5") failed: Property not found. retry in 624.363709ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7482025-01-07T05:05:27.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239") failed: Property not found. retry in 1.007177254s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7492025-01-07T05:05:27.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 754.759202ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7502025-01-07T05:05:27.925ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
7512025-01-07T05:05:27.925ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
7522025-01-07T05:05:28.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5") failed: Property not found. retry in 1.388271778s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7532025-01-07T05:05:28.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 1.287848843s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7542025-01-07T05:05:28.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239") failed: Property not found. retry in 593.900386ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7552025-01-07T05:05:29.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239") failed: Property not found. retry in 1.302619211s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7562025-01-07T05:05:29.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5") failed: Property not found. retry in 745.309603ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7572025-01-07T05:05:29.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 592.098785ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7582025-01-07T05:05:30.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5") failed: Property not found. retry in 1.464802447s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7592025-01-07T05:05:30.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 1.1420385s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7602025-01-07T05:05:30.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239") failed: Property not found. retry in 1.141433617s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7612025-01-07T05:05:31.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c") failed: Property not found. retry in 924.851895ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7622025-01-07T05:05:32.606ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_0299d0a6-05a4-400d-9b14-105f1fc11bd5
7632025-01-07T05:05:32.606ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_a45303cc-cbbc-484d-9f40-52a4c1a9be3c
7642025-01-07T05:05:32.606ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_454062aa-b5b7-4eac-a959-109647163239
7652025-01-07T05:05:32.607ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7662025-01-07T05:05:32.607ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672025-01-07T05:05:32.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8549657 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41114 req_id = 435bb594-a637-4d5b-a133-359a1dd237a8 response_code = 204 uri = /omicron-zones
7682025-01-07T05:05:32.609ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7692025-01-07T05:05:32.663ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-01-07T05:05:32.693ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 124.760458ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7712025-01-07T05:05:32.836ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-01-07T05:05:32.883ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7732025-01-07T05:05:32.883ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7742025-01-07T05:05:32.914ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7752025-01-07T05:05:32.914ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7762025-01-07T05:05:32.914ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7772025-01-07T05:05:32.944ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 0299d0a6-05a4-400d-9b14-105f1fc11bd5 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a45303cc-cbbc-484d-9f40-52a4c1a9be3c (service), filesystem_pool: Some(ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 454062aa-b5b7-4eac-a959-109647163239 (service), filesystem_pool: Some(ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 (service), filesystem_pool: Some(ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9d5df7a1-ec9c-4461-a43a-6edcaf84d83a, kind: Service { id: a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 }, name: Name("ntp-a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 222])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7782025-01-07T05:05:32.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50563
7792025-01-07T05:05:32.944ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-01-07T05:05:32.944ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-01-07T05:05:32.955ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822025-01-07T05:05:32.955ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832025-01-07T05:05:32.965ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7842025-01-07T05:05:32.965ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7852025-01-07T05:05:32.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7862025-01-07T05:05:32.974ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:177
7872025-01-07T05:05:32.974ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:177
7882025-01-07T05:05:32.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892025-01-07T05:05:32.985ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7902025-01-07T05:05:33.017ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7912025-01-07T05:05:33.018ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7922025-01-07T05:05:33.018ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7932025-01-07T05:05:33.048ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 200, 222]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7942025-01-07T05:05:33.048ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
7952025-01-07T05:05:33.049ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7962025-01-07T05:05:33.049ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7972025-01-07T05:05:33.049ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7982025-01-07T05:05:33.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7992025-01-07T05:05:33.073ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 file = illumos-utils/src/zone.rs:325
8002025-01-07T05:05:33.091ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 file = illumos-utils/src/zone.rs:363
8012025-01-07T05:05:33.750ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8022025-01-07T05:05:33.750ZINFOSledAgent (ServiceManager): Booting oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8032025-01-07T05:05:33.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18") failed: Property not found. retry in 61.389681ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8042025-01-07T05:05:33.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18") failed: Property not found. retry in 91.86563ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8052025-01-07T05:05:34.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18") failed: Property not found. retry in 101.313033ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8062025-01-07T05:05:34.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18") failed: Property not found. retry in 502.256746ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8072025-01-07T05:05:34.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18") failed: Property not found. retry in 588.164575ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8082025-01-07T05:05:35.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18") failed: Property not found. retry in 868.576002ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8092025-01-07T05:05:36.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18") failed: Property not found. retry in 1.416965339s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8102025-01-07T05:05:37.059ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15291842851821954125 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8112025-01-07T05:05:37.059ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10507353659874143342 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8122025-01-07T05:05:37.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18") failed: Property not found. retry in 1.287570968s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8132025-01-07T05:05:37.927ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8142025-01-07T05:05:37.927ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8152025-01-07T05:05:38.903ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18
8162025-01-07T05:05:38.903ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8172025-01-07T05:05:38.903ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182025-01-07T05:05:38.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5959454 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50563 req_id = 93ab25d5-3681-4cf9-b169-cc578aaec54b response_code = 204 uri = /omicron-zones
8192025-01-07T05:05:38.906ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8202025-01-07T05:05:38.938ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8212025-01-07T05:05:38.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35854
8222025-01-07T05:05:38.948ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8232025-01-07T05:05:38.948ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9850 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35854 req_id = e149a9ec-8dd8-46cb-a3a5-366a509293d0 response_code = 500 uri = /timesync
8242025-01-07T05:05:38.951ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8252025-01-07T05:05:39.097ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262025-01-07T05:05:39.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35581
8272025-01-07T05:05:41.800ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1936011877379580697 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8282025-01-07T05:05:41.907ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13818138448384747779 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8292025-01-07T05:05:42.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545810711220667196 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8302025-01-07T05:05:43.106ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8312025-01-07T05:05:43.106ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008674 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35581 req_id = 6c92cf25-428f-4137-b68c-a59f4cf84e64 response_code = 500 uri = /timesync
8322025-01-07T05:05:43.108ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8332025-01-07T05:05:43.304ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8342025-01-07T05:05:43.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33026
8352025-01-07T05:05:43.313ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8362025-01-07T05:05:43.313ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9075 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33026 req_id = 15c3c714-1fc2-4262-8fe3-83738dd0ae78 response_code = 500 uri = /timesync
8372025-01-07T05:05:43.315ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382025-01-07T05:05:43.439ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8392025-01-07T05:05:43.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62239
8402025-01-07T05:05:47.608ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15291842851821954125 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8412025-01-07T05:05:47.608ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10507353659874143342 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8422025-01-07T05:05:47.994ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8432025-01-07T05:05:47.994ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008029 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62239 req_id = 6de5edc1-18aa-4925-a968-e8a653cab7ef response_code = 500 uri = /timesync
8442025-01-07T05:05:47.997ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8452025-01-07T05:05:48.151ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8462025-01-07T05:05:48.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47317
8472025-01-07T05:05:48.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8843 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47317 req_id = 00da46cd-e919-4920-b8fd-9714bfefd5e3 response_code = 200 uri = /timesync
8482025-01-07T05:05:48.162ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8492025-01-07T05:05:48.162ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8502025-01-07T05:05:48.448ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8512025-01-07T05:05:48.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54823
8522025-01-07T05:05:48.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8978 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54823 req_id = e28d99c4-9934-43ad-843b-70c9ccebf556 response_code = 200 uri = /timesync
8532025-01-07T05:05:48.459ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8542025-01-07T05:05:48.459ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8552025-01-07T05:05:48.462ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8562025-01-07T05:05:48.462ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8572025-01-07T05:05:48.799ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8582025-01-07T05:05:48.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42618
8592025-01-07T05:05:48.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7739 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42618 req_id = b6135121-16f4-41ab-91c5-9a456929377d response_code = 200 uri = /timesync
8602025-01-07T05:05:48.810ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8612025-01-07T05:05:48.810ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8622025-01-07T05:05:49.098ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8632025-01-07T05:05:49.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45024
8642025-01-07T05:05:49.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8611 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45024 req_id = 88c9e709-401e-4a17-94d3-635ffedcc48e response_code = 200 uri = /timesync
8652025-01-07T05:05:49.110ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.195657834 } file = sled-agent/src/rack_setup/service.rs:743
8662025-01-07T05:05:49.110ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8672025-01-07T05:05:49.414ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8682025-01-07T05:05:49.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60180
8692025-01-07T05:05:49.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7579 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60180 req_id = ef93d3f8-6f16-45a9-9a90-c6619e57c55c response_code = 200 uri = /timesync
8702025-01-07T05:05:49.423ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.194804668 } file = sled-agent/src/rack_setup/service.rs:743
8712025-01-07T05:05:49.423ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8722025-01-07T05:05:49.439ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4909793256880795237 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8732025-01-07T05:05:49.439ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5920322446267519157 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8742025-01-07T05:05:50.023ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8752025-01-07T05:05:50.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53134
8762025-01-07T05:05:50.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8648 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53134 req_id = f10b1575-2202-4133-8d62-b85e1589095a response_code = 200 uri = /timesync
8772025-01-07T05:05:50.034ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.205461115 } file = sled-agent/src/rack_setup/service.rs:743
8782025-01-07T05:05:50.034ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8792025-01-07T05:05:50.616ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8802025-01-07T05:05:50.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43802
8812025-01-07T05:05:50.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7874 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43802 req_id = 22c52230-5fa4-4619-88ab-7b2d5395cb10 response_code = 200 uri = /timesync
8822025-01-07T05:05:50.626ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.203851208 } file = sled-agent/src/rack_setup/service.rs:743
8832025-01-07T05:05:50.626ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8842025-01-07T05:05:51.264ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8852025-01-07T05:05:51.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65512
8862025-01-07T05:05:51.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65512 req_id = e7fd08d8-5786-420f-a4ce-d0bb4e1423cc response_code = 200 uri = /timesync
8872025-01-07T05:05:51.275ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736226349.4666576, correction: -0.197426423 } file = sled-agent/src/rack_setup/service.rs:743
8882025-01-07T05:05:51.275ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8892025-01-07T05:05:51.930ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8902025-01-07T05:05:51.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35843
8912025-01-07T05:05:51.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8828 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35843 req_id = beb638d7-19c5-42dc-8ce0-4a98682ceac5 response_code = 200 uri = /timesync
8922025-01-07T05:05:51.941ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736226349.4666576, correction: -0.195618272 } file = sled-agent/src/rack_setup/service.rs:743
8932025-01-07T05:05:51.941ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8942025-01-07T05:05:52.111ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 314.156939ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8952025-01-07T05:05:52.329ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1936011877379580697 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8962025-01-07T05:05:52.457ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13818138448384747779 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
8972025-01-07T05:05:52.979ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8982025-01-07T05:05:52.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51929
8992025-01-07T05:05:52.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51929 req_id = 87ffbc22-67f9-4776-bc7d-52c8a768e5c9 response_code = 200 uri = /timesync
9002025-01-07T05:05:52.990ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736226349.4666576, correction: -0.186525837 } file = sled-agent/src/rack_setup/service.rs:743
9012025-01-07T05:05:52.990ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9022025-01-07T05:05:53.137ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545810711220667196 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9032025-01-07T05:05:54.384ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9042025-01-07T05:05:54.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40203
9052025-01-07T05:05:54.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8460 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40203 req_id = 9264cd57-c77e-4849-bdce-0e58c654b333 response_code = 200 uri = /timesync
9062025-01-07T05:05:54.396ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736226349.4666576, correction: -0.179460198 } file = sled-agent/src/rack_setup/service.rs:743
9072025-01-07T05:05:54.396ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9082025-01-07T05:05:55.683ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9092025-01-07T05:05:55.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61257
9102025-01-07T05:05:55.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8503 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61257 req_id = 6ae9673f-9335-446f-a3b7-96e6b1e9f79a response_code = 200 uri = /timesync
9112025-01-07T05:05:55.694ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226354.132245, correction: -0.175533235 } file = sled-agent/src/rack_setup/service.rs:743
9122025-01-07T05:05:55.694ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9132025-01-07T05:05:57.363ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9142025-01-07T05:05:57.363ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39855
9152025-01-07T05:05:57.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41176
9162025-01-07T05:05:57.363ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39855 req_id = 93d4ca48-8ec8-4970-811a-c6118e01874b response_code = 200 uri = /baseboard
9172025-01-07T05:05:57.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8662 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41176 req_id = aa792c08-d28a-4f9c-a4bc-6cabd8815b07 response_code = 200 uri = /timesync
9182025-01-07T05:05:57.374ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226356.5974135, correction: -0.171039388 } file = sled-agent/src/rack_setup/service.rs:743
9192025-01-07T05:05:57.374ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9202025-01-07T05:05:57.575ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15291842851821954125 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9212025-01-07T05:05:57.575ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10507353659874143342 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9222025-01-07T05:05:58.441ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9232025-01-07T05:05:58.441ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9242025-01-07T05:05:59.416ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4909793256880795237 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9252025-01-07T05:05:59.416ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5920322446267519157 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9262025-01-07T05:06:00.082ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9272025-01-07T05:06:00.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52280
9282025-01-07T05:06:00.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8731 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52280 req_id = 44be2692-6054-45cf-bd7f-e45bc0cb9948 response_code = 200 uri = /timesync
9292025-01-07T05:06:00.095ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226358.642523, correction: -0.163642064 } file = sled-agent/src/rack_setup/service.rs:743
9302025-01-07T05:06:00.095ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9312025-01-07T05:06:01.783ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9322025-01-07T05:06:01.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58057
9332025-01-07T05:06:01.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58057 req_id = cea7fd4b-b766-403a-a799-36b5f61d1c75 response_code = 200 uri = /timesync
9342025-01-07T05:06:01.795ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226360.33686, correction: -0.15897046 } file = sled-agent/src/rack_setup/service.rs:743
9352025-01-07T05:06:01.795ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9362025-01-07T05:06:02.303ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1936011877379580697 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9372025-01-07T05:06:02.431ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13818138448384747779 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9382025-01-07T05:06:03.111ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545810711220667196 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9392025-01-07T05:06:03.317ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9402025-01-07T05:06:03.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54101
9412025-01-07T05:06:03.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54101 req_id = 50afd4d8-6135-4ba2-81a2-2744fb540079 response_code = 200 uri = /timesync
9422025-01-07T05:06:03.330ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226362.7444663, correction: -0.154752523 } file = sled-agent/src/rack_setup/service.rs:743
9432025-01-07T05:06:03.330ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9442025-01-07T05:06:07.417ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9452025-01-07T05:06:07.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33593
9462025-01-07T05:06:07.424ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 370.617856ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9472025-01-07T05:06:07.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8782 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33593 req_id = 2abbd273-7980-4dcb-818a-a98f2af2cad3 response_code = 200 uri = /timesync
9482025-01-07T05:06:07.428ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226366.866341, correction: -0.143598124 } file = sled-agent/src/rack_setup/service.rs:743
9492025-01-07T05:06:07.428ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9502025-01-07T05:06:07.551ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15291842851821954125 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9512025-01-07T05:06:07.551ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10507353659874143342 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9522025-01-07T05:06:08.415ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9532025-01-07T05:06:08.415ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9542025-01-07T05:06:09.390ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4909793256880795237 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9552025-01-07T05:06:09.390ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5920322446267519157 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9562025-01-07T05:06:12.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1936011877379580697 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9572025-01-07T05:06:12.405ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13818138448384747779 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9582025-01-07T05:06:12.736ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9592025-01-07T05:06:12.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65386
9602025-01-07T05:06:12.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9439 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65386 req_id = 22e8ed03-9d73-4f0d-b1d2-9e5624380242 response_code = 200 uri = /timesync
9612025-01-07T05:06:12.749ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226371.5626564, correction: -0.129149184 } file = sled-agent/src/rack_setup/service.rs:743
9622025-01-07T05:06:12.749ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9632025-01-07T05:06:13.086ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545810711220667196 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9642025-01-07T05:06:17.525ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15291842851821954125 reason = Duration(60s) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9652025-01-07T05:06:17.525ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10507353659874143342 reason = Duration(60s) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9662025-01-07T05:06:18.391ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9672025-01-07T05:06:18.391ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9682025-01-07T05:06:19.016ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9692025-01-07T05:06:19.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44521
9702025-01-07T05:06:19.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9725 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44521 req_id = 810524f4-7bf6-438a-8f4c-06f90fb02212 response_code = 200 uri = /timesync
9712025-01-07T05:06:19.030ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226377.9237845, correction: -0.112022169 } file = sled-agent/src/rack_setup/service.rs:743
9722025-01-07T05:06:19.030ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9732025-01-07T05:06:19.365ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4909793256880795237 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9742025-01-07T05:06:19.365ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5920322446267519157 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9752025-01-07T05:06:22.253ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1936011877379580697 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9762025-01-07T05:06:22.379ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13818138448384747779 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9772025-01-07T05:06:22.788ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 948.569441ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9782025-01-07T05:06:23.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545810711220667196 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9792025-01-07T05:06:24.014ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9802025-01-07T05:06:24.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57635
9812025-01-07T05:06:24.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57635 req_id = c105861d-792a-4dc1-a29a-dc2f196be22d response_code = 200 uri = /timesync
9822025-01-07T05:06:24.025ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226382.7341754, correction: -0.09855248 } file = sled-agent/src/rack_setup/service.rs:743
9832025-01-07T05:06:24.025ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9842025-01-07T05:06:27.315ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58726
9852025-01-07T05:06:27.315ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58726 req_id = c9d7590e-1147-4720-9584-851b316cf901 response_code = 200 uri = /baseboard
9862025-01-07T05:06:28.365ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9872025-01-07T05:06:28.366ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9882025-01-07T05:06:29.123ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9892025-01-07T05:06:29.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47221
9902025-01-07T05:06:29.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10066 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47221 req_id = 67360dbe-1295-48bc-b375-667cefb26aff response_code = 200 uri = /timesync
9912025-01-07T05:06:29.136ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226386.436479, correction: -0.085596927 } file = sled-agent/src/rack_setup/service.rs:743
9922025-01-07T05:06:29.136ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9932025-01-07T05:06:29.340ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4909793256880795237 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9942025-01-07T05:06:29.340ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5920322446267519157 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9952025-01-07T05:06:32.228ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1936011877379580697 reason = Duration(60s) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9962025-01-07T05:06:32.353ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13818138448384747779 reason = Duration(60s) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9972025-01-07T05:06:33.033ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8545810711220667196 reason = Duration(60s) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9982025-01-07T05:06:38.341ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7944047263946179066 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
9992025-01-07T05:06:38.341ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 472951561723292690 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10002025-01-07T05:06:38.426ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10012025-01-07T05:06:38.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58641
10022025-01-07T05:06:38.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8600 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58641 req_id = 5d97fd41-e2d5-405e-b0b2-82c31756b375 response_code = 200 uri = /timesync
10032025-01-07T05:06:38.437ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226397.2789235, correction: -0.059216805 } file = sled-agent/src/rack_setup/service.rs:743
10042025-01-07T05:06:38.437ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10052025-01-07T05:06:38.729ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.853503512s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10062025-01-07T05:06:39.314ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4909793256880795237 reason = Duration(60s) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10072025-01-07T05:06:39.315ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5920322446267519157 reason = Duration(60s) sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10082025-01-07T05:06:44.496ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10092025-01-07T05:06:44.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64988
10102025-01-07T05:06:44.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64988 req_id = 234c637f-e9c6-47ed-83b9-70dfa99d9846 response_code = 200 uri = /timesync
10112025-01-07T05:06:44.518ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-07T05:06:32.353830866Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13818138448384747779 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10122025-01-07T05:06:44.520ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-07T05:06:17.525276727Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15291842851821954125 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10132025-01-07T05:06:44.520ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-07T05:06:39.315247038Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5920322446267519157 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10142025-01-07T05:06:44.521ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-07T05:06:39.314960850Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4909793256880795237 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10152025-01-07T05:06:44.521ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-07T05:06:33.033833172Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8545810711220667196 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10162025-01-07T05:06:44.521ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-07T05:06:17.525821894Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10507353659874143342 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10172025-01-07T05:06:44.521ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-07T05:06:32.228643038Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1936011877379580697 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
10182025-01-07T05:06:44.522ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1736226402.5879536, correction: -0.042730894 } file = sled-agent/src/rack_setup/service.rs:743
10192025-01-07T05:06:44.522ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10202025-01-07T05:06:44.551ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 0299d0a6-05a4-400d-9b14-105f1fc11bd5 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a45303cc-cbbc-484d-9f40-52a4c1a9be3c (service), filesystem_pool: Some(ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 454062aa-b5b7-4eac-a959-109647163239 (service), filesystem_pool: Some(ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 (service), filesystem_pool: Some(ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9d5df7a1-ec9c-4461-a43a-6edcaf84d83a, kind: Service { id: a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 }, name: Name("ntp-a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 222])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 11ecc97c-e2c4-40d3-8efd-cf979acf6482 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d0d0247-5242-4d2b-b6c9-e49c9d8ca831 (service), filesystem_pool: Some(ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } } } }, OmicronZoneConfig { id: b36df3a4-d8c8-4640-be77-8313677714b9 (service), filesystem_pool: Some(ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External } } } }, OmicronZoneConfig { id: 5d8948fb-164f-495e-baea-84d43abc5fb0 (service), filesystem_pool: Some(ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1686e8f3-858f-4261-a328-0bb7cb6a0692 (service), filesystem_pool: Some(ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10212025-01-07T05:06:44.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48766
10222025-01-07T05:06:44.551ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10232025-01-07T05:06:44.551ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10242025-01-07T05:06:44.562ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10252025-01-07T05:06:44.562ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10262025-01-07T05:06:44.572ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10272025-01-07T05:06:44.572ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, responder: ... }
10282025-01-07T05:06:44.581ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10292025-01-07T05:06:44.581ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10302025-01-07T05:06:44.590ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10312025-01-07T05:06:44.590ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10322025-01-07T05:06:44.600ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10332025-01-07T05:06:44.600ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10342025-01-07T05:06:44.610ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10352025-01-07T05:06:44.610ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10362025-01-07T05:06:44.619ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10372025-01-07T05:06:44.619ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10382025-01-07T05:06:44.628ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10392025-01-07T05:06:44.628ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:177
10402025-01-07T05:06:44.628ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:177
10412025-01-07T05:06:44.628ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10422025-01-07T05:06:44.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10432025-01-07T05:06:44.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10442025-01-07T05:06:44.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10452025-01-07T05:06:44.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10462025-01-07T05:06:44.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10472025-01-07T05:06:44.804ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692 file = illumos-utils/src/zone.rs:325
10482025-01-07T05:06:44.808ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831 file = illumos-utils/src/zone.rs:325
10492025-01-07T05:06:44.812ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 file = illumos-utils/src/zone.rs:325
10502025-01-07T05:06:44.816ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9 file = illumos-utils/src/zone.rs:325
10512025-01-07T05:06:44.821ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0 file = illumos-utils/src/zone.rs:325
10522025-01-07T05:06:44.825ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692 file = illumos-utils/src/zone.rs:363
10532025-01-07T05:06:44.830ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831 file = illumos-utils/src/zone.rs:363
10542025-01-07T05:06:44.834ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 file = illumos-utils/src/zone.rs:363
10552025-01-07T05:06:44.838ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9 file = illumos-utils/src/zone.rs:363
10562025-01-07T05:06:44.842ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0 file = illumos-utils/src/zone.rs:363
10572025-01-07T05:06:47.687ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1686e8f3-858f-4261-a328-0bb7cb6a0692'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10582025-01-07T05:06:47.687ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
10592025-01-07T05:06:47.701ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5d8948fb-164f-495e-baea-84d43abc5fb0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10602025-01-07T05:06:47.701ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
10612025-01-07T05:06:47.731ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='11ecc97c-e2c4-40d3-8efd-cf979acf6482'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622025-01-07T05:06:47.731ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
10632025-01-07T05:06:47.737ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b36df3a4-d8c8-4640-be77-8313677714b9'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10642025-01-07T05:06:47.737ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
10652025-01-07T05:06:47.808ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7d0d0247-5242-4d2b-b6c9-e49c9d8ca831'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662025-01-07T05:06:47.808ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
10672025-01-07T05:06:47.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 30.334346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
10682025-01-07T05:06:47.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 30.830656ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
10692025-01-07T05:06:47.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 70.240916ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
10702025-01-07T05:06:47.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 143.915363ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
10712025-01-07T05:06:47.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 43.88429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
10722025-01-07T05:06:47.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 145.488213ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
10732025-01-07T05:06:48.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 90.145709ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
10742025-01-07T05:06:48.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 71.722252ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
10752025-01-07T05:06:48.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 102.769793ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
10762025-01-07T05:06:48.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 237.133837ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
10772025-01-07T05:06:48.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 102.830014ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
10782025-01-07T05:06:49.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 181.143875ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
10792025-01-07T05:06:49.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 536.132435ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
10802025-01-07T05:06:49.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 65.568376ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
10812025-01-07T05:06:49.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 361.347001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
10822025-01-07T05:06:49.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 440.660955ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
10832025-01-07T05:06:49.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 117.114867ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
10842025-01-07T05:06:49.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 536.456557ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
10852025-01-07T05:06:49.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 259.882743ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
10862025-01-07T05:06:49.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 878.851444ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
10872025-01-07T05:06:49.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 923.359743ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
10882025-01-07T05:06:49.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 651.888364ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
10892025-01-07T05:06:49.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 354.913312ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
10902025-01-07T05:06:49.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 568.953093ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
10912025-01-07T05:06:50.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 756.265134ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
10922025-01-07T05:06:50.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 575.721111ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
10932025-01-07T05:06:50.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 1.290946931s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
10942025-01-07T05:06:50.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 940.97123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
10952025-01-07T05:06:50.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 1.170500299s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
10962025-01-07T05:06:50.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 734.474649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
10972025-01-07T05:06:50.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 1.120161326s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
10982025-01-07T05:06:51.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 1.104837796s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
10992025-01-07T05:06:51.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 1.217051957s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
11002025-01-07T05:06:51.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 721.69234ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
11012025-01-07T05:06:51.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 1.352047385s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
11022025-01-07T05:06:52.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 1.487631256s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
11032025-01-07T05:06:52.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 1.260867858s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
11042025-01-07T05:06:52.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 973.163643ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
11052025-01-07T05:06:52.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 753.2216ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
11062025-01-07T05:06:53.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 1.168447577s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
11072025-01-07T05:06:53.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 646.087868ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
11082025-01-07T05:06:53.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 837.181067ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
11092025-01-07T05:06:53.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 579.063087ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
11102025-01-07T05:06:53.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 977.509421ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
11112025-01-07T05:06:54.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 1.348532962s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
11122025-01-07T05:06:54.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 588.435147ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
11132025-01-07T05:06:54.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 960.423576ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
11142025-01-07T05:06:54.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 542.87449ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
11152025-01-07T05:06:54.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 656.496638ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
11162025-01-07T05:06:54.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 1.424611749s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
11172025-01-07T05:06:54.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 940.975377ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
11182025-01-07T05:06:55.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 963.740587ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
11192025-01-07T05:06:55.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 818.041936ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
11202025-01-07T05:06:55.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 1.025034746s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
11212025-01-07T05:06:55.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 1.402671468s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
11222025-01-07T05:06:56.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 1.027967808s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
11232025-01-07T05:06:56.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9") failed: Property not found. retry in 1.499869128s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
11242025-01-07T05:06:56.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 1.216084674s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
11252025-01-07T05:06:56.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831") failed: Property not found. retry in 1.208932765s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
11262025-01-07T05:06:56.569ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.839049805s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
11272025-01-07T05:06:57.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0") failed: Property not found. retry in 907.044391ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
11282025-01-07T05:06:57.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482") failed: Property not found. retry in 906.57652ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
11292025-01-07T05:06:57.267ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42985
11302025-01-07T05:06:57.267ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42985 req_id = 3a78a51f-497d-4dd0-b98f-32786ae739a9 response_code = 200 uri = /baseboard
11312025-01-07T05:06:57.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692") failed: Property not found. retry in 524.823934ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
11322025-01-07T05:06:58.184ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_1686e8f3-858f-4261-a328-0bb7cb6a0692
11332025-01-07T05:06:58.184ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_7d0d0247-5242-4d2b-b6c9-e49c9d8ca831
11342025-01-07T05:06:58.185ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482
11352025-01-07T05:06:58.185ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_b36df3a4-d8c8-4640-be77-8313677714b9
11362025-01-07T05:06:58.185ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_5d8948fb-164f-495e-baea-84d43abc5fb0
11372025-01-07T05:06:58.185ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11382025-01-07T05:06:58.185ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11392025-01-07T05:06:58.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13671442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48766 req_id = 60be5ffd-c498-4da4-928f-d607aaa1c979 response_code = 204 uri = /omicron-zones
11402025-01-07T05:06:58.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48215
11412025-01-07T05:06:58.251ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 31590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = a556b91c-f406-4a4d-90da-7990a38c10cd response_code = 500 uri = /cockroachdb
11422025-01-07T05:06:58.252ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a556b91c-f406-4a4d-90da-7990a38c10cd", "content-length": "124", "date": "Tue, 07 Jan 2025 05:06:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a556b91c-f406-4a4d-90da-7990a38c10cd" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 142.947122ms
11432025-01-07T05:06:58.423ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = a0864828-283a-4cd2-a6f2-7aeed3b5bbd3 response_code = 500 uri = /cockroachdb
11442025-01-07T05:06:58.423ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a0864828-283a-4cd2-a6f2-7aeed3b5bbd3", "content-length": "124", "date": "Tue, 07 Jan 2025 05:06:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a0864828-283a-4cd2-a6f2-7aeed3b5bbd3" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 112.903286ms
11452025-01-07T05:06:58.565ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = 11bf6235-15e5-4c5e-a776-345039c90fb3 response_code = 500 uri = /cockroachdb
11462025-01-07T05:06:58.566ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "11bf6235-15e5-4c5e-a776-345039c90fb3", "content-length": "124", "date": "Tue, 07 Jan 2025 05:06:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "11bf6235-15e5-4c5e-a776-345039c90fb3" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 108.168563ms
11472025-01-07T05:06:58.704ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = 0f82f15e-3489-4732-a123-fb9cd10dfde5 response_code = 500 uri = /cockroachdb
11482025-01-07T05:06:58.704ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0f82f15e-3489-4732-a123-fb9cd10dfde5", "content-length": "124", "date": "Tue, 07 Jan 2025 05:06:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0f82f15e-3489-4732-a123-fb9cd10dfde5" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 158.385547ms
11492025-01-07T05:06:58.892ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28634 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = 8b5ffe56-0a4f-4ec4-bd51-b3d146424bb0 response_code = 500 uri = /cockroachdb
11502025-01-07T05:06:58.892ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8b5ffe56-0a4f-4ec4-bd51-b3d146424bb0", "content-length": "124", "date": "Tue, 07 Jan 2025 05:06:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8b5ffe56-0a4f-4ec4-bd51-b3d146424bb0" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 232.667372ms
11512025-01-07T05:06:59.153ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27841 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = 73c2c3a5-a89e-4bc1-99f9-e8af4482d424 response_code = 500 uri = /cockroachdb
11522025-01-07T05:06:59.154ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "73c2c3a5-a89e-4bc1-99f9-e8af4482d424", "content-length": "124", "date": "Tue, 07 Jan 2025 05:06:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "73c2c3a5-a89e-4bc1-99f9-e8af4482d424" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 314.039846ms
11532025-01-07T05:06:59.494ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26484 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = f108595c-7e39-4446-9faf-d96e9a4bb44e response_code = 500 uri = /cockroachdb
11542025-01-07T05:06:59.495ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f108595c-7e39-4446-9faf-d96e9a4bb44e", "content-length": "124", "date": "Tue, 07 Jan 2025 05:06:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f108595c-7e39-4446-9faf-d96e9a4bb44e" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 172.197426ms
11552025-01-07T05:06:59.695ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = 59849847-81c6-42df-a6fe-aa52d325d1ab response_code = 500 uri = /cockroachdb
11562025-01-07T05:06:59.695ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "59849847-81c6-42df-a6fe-aa52d325d1ab", "content-length": "124", "date": "Tue, 07 Jan 2025 05:06:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "59849847-81c6-42df-a6fe-aa52d325d1ab" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 407.699572ms
11572025-01-07T05:07:00.132ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28348 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = 3042086e-fe90-4237-8cd1-fed74a5a40f5 response_code = 500 uri = /cockroachdb
11582025-01-07T05:07:00.132ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3042086e-fe90-4237-8cd1-fed74a5a40f5", "content-length": "124", "date": "Tue, 07 Jan 2025 05:07:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3042086e-fe90-4237-8cd1-fed74a5a40f5" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 352.460803ms
11592025-01-07T05:07:00.512ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26371 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = 4eadb1b6-bd88-49e0-9dc4-b382f08cc9d0 response_code = 500 uri = /cockroachdb
11602025-01-07T05:07:00.512ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4eadb1b6-bd88-49e0-9dc4-b382f08cc9d0", "content-length": "124", "date": "Tue, 07 Jan 2025 05:07:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4eadb1b6-bd88-49e0-9dc4-b382f08cc9d0" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 763.689282ms
11612025-01-07T05:07:01.302ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_11ecc97c-e2c4-40d3-8efd-cf979acf6482 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25511 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = daef6944-ece6-4c8c-b786-edf1a75ac3cf response_code = 500 uri = /cockroachdb
11622025-01-07T05:07:01.302ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "daef6944-ece6-4c8c-b786-edf1a75ac3cf", "content-length": "124", "date": "Tue, 07 Jan 2025 05:07:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "daef6944-ece6-4c8c-b786-edf1a75ac3cf" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 885.323661ms
11632025-01-07T05:07:02.220ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3769
11642025-01-07T05:07:10.436ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
11652025-01-07T05:07:23.487ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
11662025-01-07T05:07:23.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21298071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48215 req_id = 647e906b-d4f3-4080-b679-fb12e93aa895 response_code = 204 uri = /cockroachdb
11672025-01-07T05:07:23.493ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.768876163s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
11682025-01-07T05:07:23.525ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 0299d0a6-05a4-400d-9b14-105f1fc11bd5 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a45303cc-cbbc-484d-9f40-52a4c1a9be3c (service), filesystem_pool: Some(ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 454062aa-b5b7-4eac-a959-109647163239 (service), filesystem_pool: Some(ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 (service), filesystem_pool: Some(ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9d5df7a1-ec9c-4461-a43a-6edcaf84d83a, kind: Service { id: a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18 }, name: Name("ntp-a3b7f7f7-8dcd-4ebd-bad1-5dfff5420a18"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 222])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 11ecc97c-e2c4-40d3-8efd-cf979acf6482 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d0d0247-5242-4d2b-b6c9-e49c9d8ca831 (service), filesystem_pool: Some(ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } } } }, OmicronZoneConfig { id: b36df3a4-d8c8-4640-be77-8313677714b9 (service), filesystem_pool: Some(ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External } } } }, OmicronZoneConfig { id: 5d8948fb-164f-495e-baea-84d43abc5fb0 (service), filesystem_pool: Some(ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1686e8f3-858f-4261-a328-0bb7cb6a0692 (service), filesystem_pool: Some(ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 (service), filesystem_pool: Some(ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 217a827c-2873-4be1-b359-addf32248ae5 (service), filesystem_pool: Some(ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 (service), filesystem_pool: Some(ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 (service), filesystem_pool: Some(ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 9228d496-8409-4e5a-8025-999ee01eabf1 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: fe9fe545-3b9f-446b-9b7b-1f2287a1e4be (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } } } }, OmicronZoneConfig { id: dce16779-d2a1-44ba-aef0-18f0ec85e312 (service), filesystem_pool: Some(ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 653a431f-4317-4b8b-9765-f97b2dbe81f4 (service), filesystem_pool: Some(ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 5f5476d9-1b17-410c-815c-0626448dca85 (service), filesystem_pool: Some(ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 2bb725ac-2d0b-4982-912a-413a3e957443 (service), filesystem_pool: Some(ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1d9c66b5-4911-40d5-b0c3-c80b59c37b9b (service), filesystem_pool: Some(ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External } } } }, OmicronZoneConfig { id: a901efb5-2c24-47d3-ae6e-e79927c44c5c (service), filesystem_pool: Some(ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External } } } }, OmicronZoneConfig { id: d31e1b0e-366a-47db-9519-3ba845132e41 (service), filesystem_pool: Some(ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External } } } }, OmicronZoneConfig { id: d9619e05-7abd-45a1-b4ef-c08eed6308f0 (service), filesystem_pool: Some(ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External } } } }, OmicronZoneConfig { id: 43ddbcb5-5442-4285-bc01-5ce3ee42b899 (service), filesystem_pool: Some(ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External } } } }, OmicronZoneConfig { id: 80043182-08f6-4a8c-b31a-7dc3e520d317 (service), filesystem_pool: Some(ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External } } } }, OmicronZoneConfig { id: 63ffd674-4fd2-47e9-876b-4eeba5d6186d (service), filesystem_pool: Some(ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External } } } }, OmicronZoneConfig { id: f7cc9833-80d2-4b85-807d-0ec77247d68f (service), filesystem_pool: Some(ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11692025-01-07T05:07:23.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59693
11702025-01-07T05:07:23.526ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11712025-01-07T05:07:23.526ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11722025-01-07T05:07:23.539ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11732025-01-07T05:07:23.539ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11742025-01-07T05:07:23.551ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11752025-01-07T05:07:23.551ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: InternalDns }, responder: ... }
11762025-01-07T05:07:23.561ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11772025-01-07T05:07:23.561ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11782025-01-07T05:07:23.569ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11792025-01-07T05:07:23.569ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11802025-01-07T05:07:23.580ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11812025-01-07T05:07:23.580ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Cockroach }, responder: ... }
11822025-01-07T05:07:23.589ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11832025-01-07T05:07:23.589ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11842025-01-07T05:07:23.600ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11852025-01-07T05:07:23.600ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11862025-01-07T05:07:23.611ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11872025-01-07T05:07:23.611ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11882025-01-07T05:07:23.621ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11892025-01-07T05:07:23.621ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11902025-01-07T05:07:23.636ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11912025-01-07T05:07:23.636ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11922025-01-07T05:07:23.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11932025-01-07T05:07:23.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, kind: Crucible }, responder: ... }
11942025-01-07T05:07:23.671ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11952025-01-07T05:07:23.671ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, kind: Crucible }, responder: ... }
11962025-01-07T05:07:23.681ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11972025-01-07T05:07:23.681ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, kind: Crucible }, responder: ... }
11982025-01-07T05:07:23.691ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11992025-01-07T05:07:23.691ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, kind: Crucible }, responder: ... }
12002025-01-07T05:07:23.701ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12012025-01-07T05:07:23.701ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, kind: Crucible }, responder: ... }
12022025-01-07T05:07:23.714ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12032025-01-07T05:07:23.714ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, kind: Crucible }, responder: ... }
12042025-01-07T05:07:23.724ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12052025-01-07T05:07:23.724ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, kind: Crucible }, responder: ... }
12062025-01-07T05:07:23.743ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12072025-01-07T05:07:23.743ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, kind: Crucible }, responder: ... }
12082025-01-07T05:07:23.757ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12092025-01-07T05:07:23.757ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, kind: Crucible }, responder: ... }
12102025-01-07T05:07:23.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12112025-01-07T05:07:23.768ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:177
12122025-01-07T05:07:23.768ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:177
12132025-01-07T05:07:23.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12142025-01-07T05:07:23.933ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12152025-01-07T05:07:23.934ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12162025-01-07T05:07:23.934ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12172025-01-07T05:07:23.980ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12182025-01-07T05:07:23.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12192025-01-07T05:07:23.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12202025-01-07T05:07:23.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-01-07T05:07:23.982ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12222025-01-07T05:07:23.995ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12232025-01-07T05:07:23.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12242025-01-07T05:07:23.996ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12252025-01-07T05:07:24.191ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12262025-01-07T05:07:24.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12272025-01-07T05:07:24.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12282025-01-07T05:07:24.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12292025-01-07T05:07:24.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12302025-01-07T05:07:24.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12312025-01-07T05:07:24.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12322025-01-07T05:07:24.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12332025-01-07T05:07:24.194ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c file = illumos-utils/src/zone.rs:325
12342025-01-07T05:07:24.200ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41 file = illumos-utils/src/zone.rs:325
12352025-01-07T05:07:24.204ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899 file = illumos-utils/src/zone.rs:325
12362025-01-07T05:07:24.210ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443 file = illumos-utils/src/zone.rs:325
12372025-01-07T05:07:24.217ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d file = illumos-utils/src/zone.rs:325
12382025-01-07T05:07:24.222ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b file = illumos-utils/src/zone.rs:325
12392025-01-07T05:07:24.228ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1 file = illumos-utils/src/zone.rs:325
12402025-01-07T05:07:24.365ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c file = illumos-utils/src/zone.rs:363
12412025-01-07T05:07:24.370ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41 file = illumos-utils/src/zone.rs:363
12422025-01-07T05:07:24.375ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899 file = illumos-utils/src/zone.rs:363
12432025-01-07T05:07:24.379ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443 file = illumos-utils/src/zone.rs:363
12442025-01-07T05:07:24.384ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d file = illumos-utils/src/zone.rs:363
12452025-01-07T05:07:24.389ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b file = illumos-utils/src/zone.rs:363
12462025-01-07T05:07:24.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1 file = illumos-utils/src/zone.rs:363
12472025-01-07T05:07:24.398ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f file = illumos-utils/src/zone.rs:325
12482025-01-07T05:07:24.403ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0 file = illumos-utils/src/zone.rs:325
12492025-01-07T05:07:24.407ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317 file = illumos-utils/src/zone.rs:325
12502025-01-07T05:07:24.412ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85 file = illumos-utils/src/zone.rs:325
12512025-01-07T05:07:24.418ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be file = illumos-utils/src/zone.rs:325
12522025-01-07T05:07:24.423ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4 file = illumos-utils/src/zone.rs:325
12532025-01-07T05:07:24.429ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312 file = illumos-utils/src/zone.rs:325
12542025-01-07T05:07:24.480ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12552025-01-07T05:07:24.539ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12562025-01-07T05:07:24.540ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f file = illumos-utils/src/zone.rs:363
12572025-01-07T05:07:24.576ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0 file = illumos-utils/src/zone.rs:363
12582025-01-07T05:07:24.608ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317 file = illumos-utils/src/zone.rs:363
12592025-01-07T05:07:24.630ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85 file = illumos-utils/src/zone.rs:363
12602025-01-07T05:07:24.650ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be file = illumos-utils/src/zone.rs:363
12612025-01-07T05:07:24.670ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4 file = illumos-utils/src/zone.rs:363
12622025-01-07T05:07:24.685ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312 file = illumos-utils/src/zone.rs:363
12632025-01-07T05:07:24.762ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12642025-01-07T05:07:24.927ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12652025-01-07T05:07:24.994ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12662025-01-07T05:07:24.997ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12672025-01-07T05:07:24.997ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12682025-01-07T05:07:25.054ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 239, 186]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12692025-01-07T05:07:25.054ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
12702025-01-07T05:07:25.057ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12712025-01-07T05:07:25.057ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12722025-01-07T05:07:25.112ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 247, 159]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12732025-01-07T05:07:25.112ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
12742025-01-07T05:07:25.115ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12752025-01-07T05:07:25.115ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12762025-01-07T05:07:25.170ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 155, 96]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12772025-01-07T05:07:25.170ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12782025-01-07T05:07:25.172ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12792025-01-07T05:07:25.172ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12802025-01-07T05:07:25.227ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 129, 7]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12812025-01-07T05:07:25.227ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12822025-01-07T05:07:25.227ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12832025-01-07T05:07:25.227ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12842025-01-07T05:07:25.227ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12852025-01-07T05:07:25.227ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12862025-01-07T05:07:25.229ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12872025-01-07T05:07:25.229ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12882025-01-07T05:07:25.285ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 209, 232]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12892025-01-07T05:07:25.285ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12902025-01-07T05:07:25.285ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12912025-01-07T05:07:25.287ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12922025-01-07T05:07:25.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12932025-01-07T05:07:25.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12942025-01-07T05:07:25.388ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12952025-01-07T05:07:25.388ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12962025-01-07T05:07:25.389ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12972025-01-07T05:07:25.389ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12982025-01-07T05:07:25.389ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495 file = illumos-utils/src/zone.rs:325
12992025-01-07T05:07:25.398ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
13002025-01-07T05:07:25.398ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
13012025-01-07T05:07:25.399ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13022025-01-07T05:07:25.401ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13032025-01-07T05:07:25.405ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13042025-01-07T05:07:25.405ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13052025-01-07T05:07:25.405ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13062025-01-07T05:07:25.569ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13072025-01-07T05:07:25.569ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495 file = illumos-utils/src/zone.rs:363
13082025-01-07T05:07:25.582ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405 file = illumos-utils/src/zone.rs:325
13092025-01-07T05:07:25.689ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06 file = illumos-utils/src/zone.rs:325
13102025-01-07T05:07:25.705ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7 file = illumos-utils/src/zone.rs:325
13112025-01-07T05:07:25.718ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405 file = illumos-utils/src/zone.rs:363
13122025-01-07T05:07:25.819ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5 file = illumos-utils/src/zone.rs:325
13132025-01-07T05:07:25.835ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06 file = illumos-utils/src/zone.rs:363
13142025-01-07T05:07:25.849ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7 file = illumos-utils/src/zone.rs:363
13152025-01-07T05:07:25.874ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5 file = illumos-utils/src/zone.rs:363
13162025-01-07T05:07:27.490ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38437
13172025-01-07T05:07:27.499ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38437 req_id = 54c92d8b-3f6e-4a14-b946-2b3aeac90d13 response_code = 200 uri = /baseboard
13182025-01-07T05:07:28.704ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ba511dfe-0a9e-4d6c-b589-4d23fee4acd8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13192025-01-07T05:07:28.704ZINFOSledAgent (ServiceManager): Booting oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
13202025-01-07T05:07:28.730ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='029920a2-c900-4fa0-b036-114e14bc7b80'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212025-01-07T05:07:28.730ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_feb9b757-126c-48f6-9509-1209dc404e30/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bbf206d3-ec75-4019-a225-6f3f8faae0c6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13222025-01-07T05:07:28.732ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9ec06319-8348-4c49-b606-b9eed234158a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='71abbfe6-2d73-4929-99f1-716a5cff475f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13232025-01-07T05:07:28.732ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='620dc6f6-9e48-4fb7-be75-9d4aa1355cf8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13242025-01-07T05:07:28.733ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='efb3292b-f27a-4eb7-b6ec-9dc4fca51b5e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13252025-01-07T05:07:28.733ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
13262025-01-07T05:07:28.747ZINFOSledAgent (ServiceManager): Booting oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
13272025-01-07T05:07:28.759ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
13282025-01-07T05:07:28.773ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
13292025-01-07T05:07:28.785ZINFOSledAgent (ServiceManager): Booting oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
13302025-01-07T05:07:28.815ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13312025-01-07T05:07:28.816ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
13322025-01-07T05:07:30.334ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='47318ab4-1bdf-404f-a26f-02407c6bd6f1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13332025-01-07T05:07:30.334ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
13342025-01-07T05:07:31.946ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5bbe57c7-cdff-41cb-8e81-937c370da161/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ee429b03-c089-45b5-92f3-800ebbca35b8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13352025-01-07T05:07:31.950ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
13362025-01-07T05:07:32.788ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fb670df5-eb06-4537-8ba0-b5be2520f226/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a273bd67-4e77-4d0f-b47c-dde02b8401c6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13372025-01-07T05:07:32.789ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
13382025-01-07T05:07:32.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 28.715223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
13392025-01-07T05:07:32.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 57.196742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
13402025-01-07T05:07:32.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 58.840304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
13412025-01-07T05:07:32.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 73.457878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
13422025-01-07T05:07:33.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 55.971449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
13432025-01-07T05:07:33.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 66.052184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
13442025-01-07T05:07:33.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 56.137067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
13452025-01-07T05:07:33.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 56.819609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
13462025-01-07T05:07:33.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 73.747833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
13472025-01-07T05:07:33.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 136.67796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
13482025-01-07T05:07:33.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 145.68991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
13492025-01-07T05:07:33.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 71.713481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
13502025-01-07T05:07:33.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 239.498008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
13512025-01-07T05:07:33.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 98.849994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
13522025-01-07T05:07:33.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 196.45728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
13532025-01-07T05:07:33.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 52.08411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
13542025-01-07T05:07:33.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 148.595267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
13552025-01-07T05:07:33.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 60.899922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
13562025-01-07T05:07:33.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 105.810397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
13572025-01-07T05:07:33.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 243.94187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
13582025-01-07T05:07:33.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 125.129652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
13592025-01-07T05:07:33.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 134.447847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
13602025-01-07T05:07:33.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 200.633187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
13612025-01-07T05:07:33.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 158.083854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
13622025-01-07T05:07:33.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 316.232546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
13632025-01-07T05:07:33.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 591.197383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
13642025-01-07T05:07:33.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 26.806184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
13652025-01-07T05:07:33.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 286.318859ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
13662025-01-07T05:07:33.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 430.691944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
13672025-01-07T05:07:33.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 578.023551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
13682025-01-07T05:07:33.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 73.794269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
13692025-01-07T05:07:33.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 74.375556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
13702025-01-07T05:07:33.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 284.680574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
13712025-01-07T05:07:33.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 328.968784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
13722025-01-07T05:07:33.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 112.597099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
13732025-01-07T05:07:33.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 434.460369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
13742025-01-07T05:07:33.855ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='9228d496-8409-4e5a-8025-999ee01eabf1'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13752025-01-07T05:07:33.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 320.09678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
13762025-01-07T05:07:33.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 272.016208ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
13772025-01-07T05:07:33.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.183355687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
13782025-01-07T05:07:33.994ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13792025-01-07T05:07:33.995ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13802025-01-07T05:07:34.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 512.7581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
13812025-01-07T05:07:34.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 711.206497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
13822025-01-07T05:07:34.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.072008668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
13832025-01-07T05:07:34.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 160.560675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
13842025-01-07T05:07:34.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.045360137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
13852025-01-07T05:07:34.229ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
13862025-01-07T05:07:34.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.124334992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
13872025-01-07T05:07:34.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 400.905183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
13882025-01-07T05:07:34.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 413.431368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
13892025-01-07T05:07:34.277ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
13902025-01-07T05:07:34.283ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
13912025-01-07T05:07:34.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.463654011s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
13922025-01-07T05:07:34.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 227.339761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
13932025-01-07T05:07:34.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 38.91459ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
13942025-01-07T05:07:34.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 558.10064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
13952025-01-07T05:07:34.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 621.635569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
13962025-01-07T05:07:34.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 144.09803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
13972025-01-07T05:07:34.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 863.608043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
13982025-01-07T05:07:34.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 925.417536ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
13992025-01-07T05:07:34.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 25.002751ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14002025-01-07T05:07:34.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 59.971885ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14012025-01-07T05:07:34.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 275.412882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
14022025-01-07T05:07:34.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 36.776667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14032025-01-07T05:07:34.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 259.991922ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14042025-01-07T05:07:34.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 55.069356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14052025-01-07T05:07:34.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 762.246975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
14062025-01-07T05:07:35.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 101.548601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14072025-01-07T05:07:35.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 204.284662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
14082025-01-07T05:07:35.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 427.088648ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14092025-01-07T05:07:35.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.045226616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
14102025-01-07T05:07:35.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 426.36762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14112025-01-07T05:07:35.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.185119564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
14122025-01-07T05:07:35.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 855.597894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
14132025-01-07T05:07:36.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 590.579991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
14142025-01-07T05:07:36.002ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14152025-01-07T05:07:36.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 691.326501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
14162025-01-07T05:07:36.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 627.151449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
14172025-01-07T05:07:36.024ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14182025-01-07T05:07:36.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.415830788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
14192025-01-07T05:07:36.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.14048035s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14202025-01-07T05:07:36.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.373027906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
14212025-01-07T05:07:36.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.108402677s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
14222025-01-07T05:07:36.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 736.986753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
14232025-01-07T05:07:36.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 962.873753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
14242025-01-07T05:07:36.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 609.518857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14252025-01-07T05:07:36.103ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14262025-01-07T05:07:36.109ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14272025-01-07T05:07:36.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 724.317952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
14282025-01-07T05:07:36.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 50.414261ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14292025-01-07T05:07:36.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 68.765778ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14302025-01-07T05:07:36.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 71.624622ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14312025-01-07T05:07:36.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 531.758683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
14322025-01-07T05:07:36.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 212.267225ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14332025-01-07T05:07:36.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 83.774384ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14342025-01-07T05:07:36.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 102.724613ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14352025-01-07T05:07:36.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 703.721959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
14362025-01-07T05:07:36.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 646.114039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
14372025-01-07T05:07:36.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 377.300071ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14382025-01-07T05:07:36.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 220.172738ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14392025-01-07T05:07:36.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 669.238923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
14402025-01-07T05:07:36.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 562.469784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14412025-01-07T05:07:36.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 578.96722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
14422025-01-07T05:07:36.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 699.321064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
14432025-01-07T05:07:36.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 536.151548ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14442025-01-07T05:07:36.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 792.955891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
14452025-01-07T05:07:36.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 888.368895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
14462025-01-07T05:07:37.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.106004908s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14472025-01-07T05:07:37.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 834.652267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
14482025-01-07T05:07:37.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 849.403702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
14492025-01-07T05:07:37.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.040068145s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14502025-01-07T05:07:37.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 876.630779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14512025-01-07T05:07:37.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 984.055102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
14522025-01-07T05:07:37.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 735.173986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
14532025-01-07T05:07:37.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.495703505s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
14542025-01-07T05:07:37.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.216826913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
14552025-01-07T05:07:37.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 584.507033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
14562025-01-07T05:07:37.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 989.729726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
14572025-01-07T05:07:37.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 559.168996ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14582025-01-07T05:07:37.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 685.936164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
14592025-01-07T05:07:37.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.032506437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
14602025-01-07T05:07:37.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 573.769057ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
14612025-01-07T05:07:37.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.199373799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
14622025-01-07T05:07:38.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 650.259585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
14632025-01-07T05:07:38.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 1.347695055s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14642025-01-07T05:07:38.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 698.074137ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
14652025-01-07T05:07:38.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 778.161914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
14662025-01-07T05:07:38.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 689.836158ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14672025-01-07T05:07:38.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.188389808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14682025-01-07T05:07:38.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 537.712989ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14692025-01-07T05:07:38.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.067660094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
14702025-01-07T05:07:38.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.236010756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
14712025-01-07T05:07:38.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.33998384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
14722025-01-07T05:07:38.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.330395422s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
14732025-01-07T05:07:38.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.239321433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
14742025-01-07T05:07:38.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 840.275463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
14752025-01-07T05:07:38.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 852.01671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
14762025-01-07T05:07:38.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.225548894s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14772025-01-07T05:07:38.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.229080895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
14782025-01-07T05:07:38.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 839.130508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
14792025-01-07T05:07:38.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.088553233s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14802025-01-07T05:07:38.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 579.552581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
14812025-01-07T05:07:38.912ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14822025-01-07T05:07:38.912ZINFOSledAgent (ServiceManager): Booting oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
14832025-01-07T05:07:39.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 916.75282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
14842025-01-07T05:07:39.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 62.525027ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
14852025-01-07T05:07:39.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 77.437558ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
14862025-01-07T05:07:39.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 133.988379ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
14872025-01-07T05:07:39.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 942.191633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
14882025-01-07T05:07:39.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.355937918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
14892025-01-07T05:07:39.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 910.820576ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
14902025-01-07T05:07:39.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 486.973592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
14912025-01-07T05:07:39.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.090963632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
14922025-01-07T05:07:39.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 687.607677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
14932025-01-07T05:07:40.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 991.702281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
14942025-01-07T05:07:40.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 980.227042ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
14952025-01-07T05:07:40.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 518.957941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
14962025-01-07T05:07:40.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 622.342962ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
14972025-01-07T05:07:40.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.128249343s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
14982025-01-07T05:07:40.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 671.83383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
14992025-01-07T05:07:40.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.114401704s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
15002025-01-07T05:07:40.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.095570797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
15012025-01-07T05:07:40.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.336107841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
15022025-01-07T05:07:40.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 856.423265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
15032025-01-07T05:07:40.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.062210477s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
15042025-01-07T05:07:40.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.09863621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
15052025-01-07T05:07:40.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 899.590053ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
15062025-01-07T05:07:40.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 837.050126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
15072025-01-07T05:07:40.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 987.194331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
15082025-01-07T05:07:40.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 651.1708ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
15092025-01-07T05:07:40.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.153631425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
15102025-01-07T05:07:40.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 688.551035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
15112025-01-07T05:07:41.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.053754609s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
15122025-01-07T05:07:41.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 763.199107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
15132025-01-07T05:07:41.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 889.22076ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
15142025-01-07T05:07:41.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 534.377236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
15152025-01-07T05:07:41.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 563.204379ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
15162025-01-07T05:07:41.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 742.663931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
15172025-01-07T05:07:41.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 865.927129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
15182025-01-07T05:07:41.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 1.411942852s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
15192025-01-07T05:07:41.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.135047388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
15202025-01-07T05:07:41.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.107277107s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
15212025-01-07T05:07:41.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.276429553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
15222025-01-07T05:07:41.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 725.640759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
15232025-01-07T05:07:41.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 819.314747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
15242025-01-07T05:07:41.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 925.440679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
15252025-01-07T05:07:41.558ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15262025-01-07T05:07:41.558ZINFOSledAgent (ServiceManager): Booting oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
15272025-01-07T05:07:41.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 804.247661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
15282025-01-07T05:07:41.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 858.11082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
15292025-01-07T05:07:41.755ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15302025-01-07T05:07:41.755ZINFOSledAgent (ServiceManager): Booting oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
15312025-01-07T05:07:41.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 594.722104ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
15322025-01-07T05:07:41.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 978.219365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
15332025-01-07T05:07:41.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 58.965746ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
15342025-01-07T05:07:41.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.110601092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
15352025-01-07T05:07:41.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 85.29354ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
15362025-01-07T05:07:41.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.202963359s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
15372025-01-07T05:07:41.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.396948178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
15382025-01-07T05:07:42.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 139.439606ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
15392025-01-07T05:07:42.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 48.037763ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
15402025-01-07T05:07:42.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 577.582653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
15412025-01-07T05:07:42.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 141.645654ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
15422025-01-07T05:07:42.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.424307049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
15432025-01-07T05:07:42.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 995.141501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
15442025-01-07T05:07:42.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 343.07916ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
15452025-01-07T05:07:42.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 157.879506ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
15462025-01-07T05:07:42.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.047527495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
15472025-01-07T05:07:42.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.0411831s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
15482025-01-07T05:07:42.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.456700498s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
15492025-01-07T05:07:42.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.416979574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
15502025-01-07T05:07:42.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 434.833832ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
15512025-01-07T05:07:42.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.155657891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
15522025-01-07T05:07:42.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 931.988137ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
15532025-01-07T05:07:42.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 1.022881778s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
15542025-01-07T05:07:42.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 519.172058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
15552025-01-07T05:07:42.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 831.400867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
15562025-01-07T05:07:42.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 1.115350957s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
15572025-01-07T05:07:42.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 731.193503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
15582025-01-07T05:07:42.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.094985005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
15592025-01-07T05:07:42.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 1.002303569s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
15602025-01-07T05:07:43.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 655.432881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
15612025-01-07T05:07:43.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.195762356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
15622025-01-07T05:07:43.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.373445488s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
15632025-01-07T05:07:43.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 651.365194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
15642025-01-07T05:07:43.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.126492629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
15652025-01-07T05:07:43.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 861.275081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
15662025-01-07T05:07:43.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 538.82752ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
15672025-01-07T05:07:43.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.429053785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
15682025-01-07T05:07:43.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.175054398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
15692025-01-07T05:07:43.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.091231197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
15702025-01-07T05:07:43.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 819.604956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
15712025-01-07T05:07:43.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 1.439802998s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
15722025-01-07T05:07:43.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.022553793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
15732025-01-07T05:07:43.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 681.24826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
15742025-01-07T05:07:43.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 731.102444ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
15752025-01-07T05:07:43.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 713.215464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
15762025-01-07T05:07:43.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.392398223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
15772025-01-07T05:07:43.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 646.77382ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
15782025-01-07T05:07:43.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 828.906752ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
15792025-01-07T05:07:43.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.431935272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
15802025-01-07T05:07:43.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 950.403895ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
15812025-01-07T05:07:44.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.112965283s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
15822025-01-07T05:07:44.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.10305661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
15832025-01-07T05:07:44.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 515.098428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
15842025-01-07T05:07:44.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 943.510508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
15852025-01-07T05:07:44.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 905.231392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
15862025-01-07T05:07:44.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.182143783s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
15872025-01-07T05:07:44.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 686.265393ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
15882025-01-07T05:07:44.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 655.106776ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
15892025-01-07T05:07:44.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.024856292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
15902025-01-07T05:07:44.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 807.154716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
15912025-01-07T05:07:44.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.451571085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
15922025-01-07T05:07:44.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 651.377568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
15932025-01-07T05:07:44.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 676.632802ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
15942025-01-07T05:07:44.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.184116244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
15952025-01-07T05:07:44.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.289243917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
15962025-01-07T05:07:44.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.397168406s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
15972025-01-07T05:07:45.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 1.2392777s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
15982025-01-07T05:07:45.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 562.905834ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
15992025-01-07T05:07:45.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 821.352312ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
16002025-01-07T05:07:45.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.273448644s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
16012025-01-07T05:07:45.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 514.87521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
16022025-01-07T05:07:45.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 705.254335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
16032025-01-07T05:07:45.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 633.041249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
16042025-01-07T05:07:45.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 931.074885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
16052025-01-07T05:07:45.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 703.838736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
16062025-01-07T05:07:45.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 1.447750902s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
16072025-01-07T05:07:45.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.34675587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
16082025-01-07T05:07:45.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 997.837333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
16092025-01-07T05:07:45.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.464161642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
16102025-01-07T05:07:45.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 763.168412ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
16112025-01-07T05:07:45.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.374970854s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
16122025-01-07T05:07:45.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 918.845438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
16132025-01-07T05:07:46.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.21291097s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
16142025-01-07T05:07:46.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.042417462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
16152025-01-07T05:07:46.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.362206344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
16162025-01-07T05:07:46.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 867.249566ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
16172025-01-07T05:07:46.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.385647984s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
16182025-01-07T05:07:46.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 995.073437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
16192025-01-07T05:07:46.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 610.078842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
16202025-01-07T05:07:46.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 1.170102216s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
16212025-01-07T05:07:46.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.026040547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
16222025-01-07T05:07:46.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 739.524385ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
16232025-01-07T05:07:46.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.490083236s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
16242025-01-07T05:07:46.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.196193206s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
16252025-01-07T05:07:46.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.477979881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
16262025-01-07T05:07:46.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.318318618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
16272025-01-07T05:07:46.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 809.747038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
16282025-01-07T05:07:46.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.339292881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
16292025-01-07T05:07:46.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 926.444368ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
16302025-01-07T05:07:46.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 1.049202438s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
16312025-01-07T05:07:47.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.060608025s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
16322025-01-07T05:07:47.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.063853337s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
16332025-01-07T05:07:47.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 774.246191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
16342025-01-07T05:07:47.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.092200211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
16352025-01-07T05:07:47.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.352689186s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
16362025-01-07T05:07:47.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 887.130609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
16372025-01-07T05:07:47.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.156905116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
16382025-01-07T05:07:47.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 704.552341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
16392025-01-07T05:07:47.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 709.524087ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
16402025-01-07T05:07:47.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 506.952177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
16412025-01-07T05:07:47.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 956.389472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
16422025-01-07T05:07:47.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.497810819s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
16432025-01-07T05:07:47.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 1.159726488s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
16442025-01-07T05:07:47.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 863.061816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
16452025-01-07T05:07:47.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.384904042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
16462025-01-07T05:07:48.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.24701524s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
16472025-01-07T05:07:48.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 1.107640464s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
16482025-01-07T05:07:48.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.207337113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
16492025-01-07T05:07:48.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 828.312417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
16502025-01-07T05:07:48.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.497615703s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
16512025-01-07T05:07:48.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.142614807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
16522025-01-07T05:07:48.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 776.823126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
16532025-01-07T05:07:48.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 979.708771ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
16542025-01-07T05:07:48.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 992.535836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
16552025-01-07T05:07:48.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 535.885335ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
16562025-01-07T05:07:48.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.040971577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
16572025-01-07T05:07:48.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 597.67313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
16582025-01-07T05:07:48.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.293520011s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
16592025-01-07T05:07:48.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 961.823233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
16602025-01-07T05:07:48.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 827.663798ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
16612025-01-07T05:07:48.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.067176077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
16622025-01-07T05:07:48.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 869.618186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
16632025-01-07T05:07:48.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 944.541691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
16642025-01-07T05:07:49.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 1.33760058s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
16652025-01-07T05:07:49.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 579.66596ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
16662025-01-07T05:07:49.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.154268604s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
16672025-01-07T05:07:49.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.223738077s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
16682025-01-07T05:07:49.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.118378731s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
16692025-01-07T05:07:49.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.122258443s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
16702025-01-07T05:07:49.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 845.35512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
16712025-01-07T05:07:49.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.149774843s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
16722025-01-07T05:07:49.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 737.848112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
16732025-01-07T05:07:49.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 715.992112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
16742025-01-07T05:07:49.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 988.895389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
16752025-01-07T05:07:49.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 920.748979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
16762025-01-07T05:07:49.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 776.673594ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
16772025-01-07T05:07:49.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.262297195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
16782025-01-07T05:07:49.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 827.667763ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
16792025-01-07T05:07:49.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 556.274737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
16802025-01-07T05:07:49.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 653.196806ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
16812025-01-07T05:07:49.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.105027362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
16822025-01-07T05:07:49.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.129386913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
16832025-01-07T05:07:50.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 634.519931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
16842025-01-07T05:07:50.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 682.01598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
16852025-01-07T05:07:50.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 514.338562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
16862025-01-07T05:07:50.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 582.92944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
16872025-01-07T05:07:50.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.197351766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
16882025-01-07T05:07:50.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 786.51336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
16892025-01-07T05:07:50.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 633.199681ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
16902025-01-07T05:07:50.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 1.195751811s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
16912025-01-07T05:07:50.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 819.907167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
16922025-01-07T05:07:50.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 1.114551231s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
16932025-01-07T05:07:50.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 660.206682ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
16942025-01-07T05:07:50.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 783.089954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
16952025-01-07T05:07:50.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.363586133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
16962025-01-07T05:07:50.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.299411893s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
16972025-01-07T05:07:50.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 1.119882385s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
16982025-01-07T05:07:50.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.497298101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
16992025-01-07T05:07:50.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 671.533676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
17002025-01-07T05:07:50.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 811.357698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
17012025-01-07T05:07:50.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.310284707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
17022025-01-07T05:07:50.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.423847656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
17032025-01-07T05:07:50.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.048720728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
17042025-01-07T05:07:50.981ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.954781081s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
17052025-01-07T05:07:50.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 955.72341ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
17062025-01-07T05:07:51.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 941.767701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
17072025-01-07T05:07:51.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 531.109189ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
17082025-01-07T05:07:51.078ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
17092025-01-07T05:07:51.079ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
17102025-01-07T05:07:51.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.249141113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
17112025-01-07T05:07:51.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.479833486s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
17122025-01-07T05:07:51.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.237736796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
17132025-01-07T05:07:51.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 65.235261ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
17142025-01-07T05:07:51.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.475683233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
17152025-01-07T05:07:51.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 131.615947ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
17162025-01-07T05:07:51.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 1.014423725s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
17172025-01-07T05:07:51.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.377408923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
17182025-01-07T05:07:51.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.256302194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
17192025-01-07T05:07:51.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 640.34462ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
17202025-01-07T05:07:51.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 678.395183ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
17212025-01-07T05:07:51.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 932.411837ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
17222025-01-07T05:07:51.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.169877457s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
17232025-01-07T05:07:51.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 125.195283ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
17242025-01-07T05:07:51.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.156289296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
17252025-01-07T05:07:51.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 825.119662ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
17262025-01-07T05:07:51.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 513.052911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
17272025-01-07T05:07:52.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 546.119213ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
17282025-01-07T05:07:52.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 884.165033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
17292025-01-07T05:07:52.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 657.944232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
17302025-01-07T05:07:52.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.475883201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
17312025-01-07T05:07:52.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 805.828965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
17322025-01-07T05:07:52.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.497021144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
17332025-01-07T05:07:52.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 583.499711ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
17342025-01-07T05:07:52.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 705.234309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
17352025-01-07T05:07:52.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 605.807909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
17362025-01-07T05:07:52.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.250385371s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
17372025-01-07T05:07:52.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 837.509836ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
17382025-01-07T05:07:52.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 795.092722ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
17392025-01-07T05:07:52.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 529.937021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
17402025-01-07T05:07:52.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.45409857s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
17412025-01-07T05:07:52.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.167635413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
17422025-01-07T05:07:52.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 1.397314416s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
17432025-01-07T05:07:52.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 627.621977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
17442025-01-07T05:07:52.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.05070537s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
17452025-01-07T05:07:53.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.225603648s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
17462025-01-07T05:07:53.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 993.861496ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
17472025-01-07T05:07:53.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 1.304708588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
17482025-01-07T05:07:53.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 958.304064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
17492025-01-07T05:07:53.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 809.098876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
17502025-01-07T05:07:53.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 553.524632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
17512025-01-07T05:07:53.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.174697054s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
17522025-01-07T05:07:53.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 931.228653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
17532025-01-07T05:07:53.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 908.359785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
17542025-01-07T05:07:53.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 1.432928707s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
17552025-01-07T05:07:53.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 1.262675406s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
17562025-01-07T05:07:53.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 869.652921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
17572025-01-07T05:07:53.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 708.481398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
17582025-01-07T05:07:53.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.42597652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
17592025-01-07T05:07:53.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 555.393818ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
17602025-01-07T05:07:53.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 825.591107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
17612025-01-07T05:07:53.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.109240516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
17622025-01-07T05:07:53.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.341077739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
17632025-01-07T05:07:54.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.349513238s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
17642025-01-07T05:07:54.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.43313676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
17652025-01-07T05:07:54.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 700.822241ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
17662025-01-07T05:07:54.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 590.798872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
17672025-01-07T05:07:54.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.488943249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
17682025-01-07T05:07:54.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 937.758291ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
17692025-01-07T05:07:54.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.21924902s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
17702025-01-07T05:07:54.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 690.552357ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
17712025-01-07T05:07:54.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 1.365467272s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
17722025-01-07T05:07:54.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.004886833s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
17732025-01-07T05:07:54.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.106523699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
17742025-01-07T05:07:54.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 932.332783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
17752025-01-07T05:07:54.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 600.731435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
17762025-01-07T05:07:54.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 672.875432ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
17772025-01-07T05:07:54.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 668.540613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
17782025-01-07T05:07:54.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 690.982036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
17792025-01-07T05:07:54.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 749.466214ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
17802025-01-07T05:07:54.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 831.747444ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
17812025-01-07T05:07:55.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 551.867114ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
17822025-01-07T05:07:55.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.381903514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
17832025-01-07T05:07:55.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 657.024066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
17842025-01-07T05:07:55.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 1.447869516s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
17852025-01-07T05:07:55.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.381638641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
17862025-01-07T05:07:55.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.159781826s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
17872025-01-07T05:07:55.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 585.035514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
17882025-01-07T05:07:55.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.173076964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
17892025-01-07T05:07:55.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 982.624661ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
17902025-01-07T05:07:55.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.40703579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
17912025-01-07T05:07:55.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 952.910974ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
17922025-01-07T05:07:55.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 963.047811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
17932025-01-07T05:07:55.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.098423047s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
17942025-01-07T05:07:55.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 932.428515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
17952025-01-07T05:07:55.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 859.293991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
17962025-01-07T05:07:55.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 1.260633127s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
17972025-01-07T05:07:55.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 1.289316592s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
17982025-01-07T05:07:55.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 1.303770496s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
17992025-01-07T05:07:55.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 807.29893ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
18002025-01-07T05:07:55.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 825.428815ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
18012025-01-07T05:07:55.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.021232059s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
18022025-01-07T05:07:55.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 733.315444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
18032025-01-07T05:07:56.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 839.298511ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
18042025-01-07T05:07:56.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 761.135809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
18052025-01-07T05:07:56.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443") failed: Property not found. retry in 1.452919406s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
18062025-01-07T05:07:56.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0") failed: Property not found. retry in 1.329678736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
18072025-01-07T05:07:56.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85") failed: Property not found. retry in 1.049443534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
18082025-01-07T05:07:56.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 624.112772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
18092025-01-07T05:07:56.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 987.829173ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
18102025-01-07T05:07:56.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b") failed: Property not found. retry in 1.07706227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
18112025-01-07T05:07:56.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 1.141538369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
18122025-01-07T05:07:56.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 998.992684ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
18132025-01-07T05:07:56.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 639.611589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
18142025-01-07T05:07:56.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 768.471062ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
18152025-01-07T05:07:56.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06") failed: Property not found. retry in 1.190277485s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
18162025-01-07T05:07:56.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 704.701051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
18172025-01-07T05:07:56.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c") failed: Property not found. retry in 1.38234044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
18182025-01-07T05:07:56.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899") failed: Property not found. retry in 1.17842256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
18192025-01-07T05:07:56.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 918.710449ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
18202025-01-07T05:07:56.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 744.141273ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
18212025-01-07T05:07:56.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 702.204105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
18222025-01-07T05:07:57.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312") failed: Property not found. retry in 1.254952073s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
18232025-01-07T05:07:57.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4") failed: Property not found. retry in 1.28637138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
18242025-01-07T05:07:57.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7") failed: Property not found. retry in 1.289007849s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
18252025-01-07T05:07:57.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f") failed: Property not found. retry in 1.069465479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
18262025-01-07T05:07:57.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5") failed: Property not found. retry in 1.132204662s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
18272025-01-07T05:07:57.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41") failed: Property not found. retry in 955.800638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
18282025-01-07T05:07:57.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 1.090947609s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
18292025-01-07T05:07:57.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405") failed: Property not found. retry in 952.119015ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
18302025-01-07T05:07:57.618ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32846
18312025-01-07T05:07:57.622ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32846 req_id = 1ea36b04-d91a-4d2d-968f-5a8c0cf3e2f2 response_code = 200 uri = /baseboard
18322025-01-07T05:07:57.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1") failed: Property not found. retry in 879.307834ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
18332025-01-07T05:07:57.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317") failed: Property not found. retry in 794.767652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
18342025-01-07T05:07:57.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d") failed: Property not found. retry in 664.971618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
18352025-01-07T05:07:57.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495") failed: Property not found. retry in 799.780537ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
18362025-01-07T05:07:58.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 1.476074005s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
18372025-01-07T05:08:00.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be") failed: Property not found. retry in 1.230084471s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
18382025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_a901efb5-2c24-47d3-ae6e-e79927c44c5c
18392025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_d31e1b0e-366a-47db-9519-3ba845132e41
18402025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_d6d3a760-2531-491d-aca9-1e6a70cf3495
18412025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_43ddbcb5-5442-4285-bc01-5ce3ee42b899
18422025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_2bb725ac-2d0b-4982-912a-413a3e957443
18432025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_63ffd674-4fd2-47e9-876b-4eeba5d6186d
18442025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_0a80e2dd-4624-43a9-991c-3c9aab3ac405
18452025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_217a827c-2873-4be1-b359-addf32248ae5
18462025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_1d9c66b5-4911-40d5-b0c3-c80b59c37b9b
18472025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_391be182-e0eb-4a5f-9294-ce54683c0a06
18482025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_9228d496-8409-4e5a-8025-999ee01eabf1
18492025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_f7cc9833-80d2-4b85-807d-0ec77247d68f
18502025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_d9619e05-7abd-45a1-b4ef-c08eed6308f0
18512025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_80043182-08f6-4a8c-b31a-7dc3e520d317
18522025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_5f5476d9-1b17-410c-815c-0626448dca85
18532025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_fe9fe545-3b9f-446b-9b7b-1f2287a1e4be
18542025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_16170e64-6e04-462f-9cc9-85cafa82d6f7
18552025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_653a431f-4317-4b8b-9765-f97b2dbe81f4
18562025-01-07T05:08:01.548ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_dce16779-d2a1-44ba-aef0-18f0ec85e312
18572025-01-07T05:08:01.559ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18582025-01-07T05:08:01.563ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18592025-01-07T05:08:01.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38042792 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59693 req_id = 4ba701f0-4336-49ff-947b-4986e06a80d7 response_code = 204 uri = /omicron-zones
18602025-01-07T05:08:01.586ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18612025-01-07T05:08:01.743ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18622025-01-07T05:08:01.745ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:802
18632025-01-07T05:08:01.790ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
18642025-01-07T05:08:01.872ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18652025-01-07T05:08:02.016ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18662025-01-07T05:08:02.173ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18672025-01-07T05:08:02.297ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18682025-01-07T05:08:02.520ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18692025-01-07T05:08:02.768ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18702025-01-07T05:08:03.071ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18712025-01-07T05:08:03.468ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18722025-01-07T05:08:03.749ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18732025-01-07T05:08:04.086ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18742025-01-07T05:08:04.605ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18752025-01-07T05:08:05.232ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/7854418f-54cc-4b31-99a7-d8502eb03ebe/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18762025-01-07T05:08:06.235ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "a5c1a98f-2f2a-48d3-9333-20629a637443", "content-length": "113", "date": "Tue, 07 Jan 2025 05:08:06 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "a5c1a98f-2f2a-48d3-9333-20629a637443" } file = sled-agent/src/rack_setup/service.rs:1078
18772025-01-07T05:08:07.557ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d310465d-f6fc-4286-a006-582d84f4ead7", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"7854418f-54cc-4b31-99a7-d8502eb03ebe\"", request_id: "d310465d-f6fc-4286-a006-582d84f4ead7" } file = sled-agent/src/rack_setup/service.rs:1078
18782025-01-07T05:08:09.613ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ac81ae84-cc47-45c4-a917-4cef50345e35", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "ac81ae84-cc47-45c4-a917-4cef50345e35" } file = sled-agent/src/rack_setup/service.rs:1078
18792025-01-07T05:08:11.195ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "025c71e5-5358-42ac-b0de-fbf052af144a", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "025c71e5-5358-42ac-b0de-fbf052af144a" } file = sled-agent/src/rack_setup/service.rs:1078
18802025-01-07T05:08:12.646ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "724fdc39-6c35-4897-808a-5a7059783653", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "724fdc39-6c35-4897-808a-5a7059783653" } file = sled-agent/src/rack_setup/service.rs:1078
18812025-01-07T05:08:14.728ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "95b0905e-9a0d-45dd-a449-556172dce550", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "95b0905e-9a0d-45dd-a449-556172dce550" } file = sled-agent/src/rack_setup/service.rs:1078
18822025-01-07T05:08:17.328ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "79971947-e104-4ce1-b26b-a2c71213ab42", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "79971947-e104-4ce1-b26b-a2c71213ab42" } file = sled-agent/src/rack_setup/service.rs:1078
18832025-01-07T05:08:21.338ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "807ad5fe-073b-4809-8e86-736f91ac720e", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "807ad5fe-073b-4809-8e86-736f91ac720e" } file = sled-agent/src/rack_setup/service.rs:1078
18842025-01-07T05:08:25.042ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d948f214-a547-476d-adf9-8e0551c4aa78", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "d948f214-a547-476d-adf9-8e0551c4aa78" } file = sled-agent/src/rack_setup/service.rs:1078
18852025-01-07T05:08:27.659ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46669
18862025-01-07T05:08:27.659ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46669 req_id = 8fe23d21-5bad-4a5c-b4ae-ce9691419a49 response_code = 200 uri = /baseboard
18872025-01-07T05:08:30.959ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "182d56d3-ba03-4d7a-91db-646d6c8c4f0b", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "182d56d3-ba03-4d7a-91db-646d6c8c4f0b" } file = sled-agent/src/rack_setup/service.rs:1078
18882025-01-07T05:08:36.994ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d5786cf3-089b-4232-ab71-123b9cb10f45", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "d5786cf3-089b-4232-ab71-123b9cb10f45" } file = sled-agent/src/rack_setup/service.rs:1078
18892025-01-07T05:08:41.726ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6369261c-7826-4477-8a00-70fc67c57761", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "6369261c-7826-4477-8a00-70fc67c57761" } file = sled-agent/src/rack_setup/service.rs:1078
18902025-01-07T05:08:46.469ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "37ec6114-aa39-43fb-b4d6-ebf743bef8c8", "content-length": "173", "date": "Tue, 07 Jan 2025 05:08:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed42aaef-618c-4920-bad3-c2a5ed2fd546\"", request_id: "37ec6114-aa39-43fb-b4d6-ebf743bef8c8" } file = sled-agent/src/rack_setup/service.rs:1078
18912025-01-07T05:08:51.311ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:46453 remote_addr = [fd00:1122:3344:101::d]:56037 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
18922025-01-07T05:08:51.328ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15459 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 3f9d0e20-7b62-48c5-8939-834f2a071c76 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
18932025-01-07T05:08:51.997ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
18942025-01-07T05:08:52.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44548
18952025-01-07T05:08:52.206ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18962025-01-07T05:08:52.206ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18972025-01-07T05:08:52.206ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:177
18982025-01-07T05:08:52.207ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:177
18992025-01-07T05:08:52.220ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19002025-01-07T05:08:52.220ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5bbe57c7-cdff-41cb-8e81-937c370da161
19012025-01-07T05:08:52.243ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19022025-01-07T05:08:52.243ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5
19032025-01-07T05:08:52.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19042025-01-07T05:08:52.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ec06319-8348-4c49-b606-b9eed234158a
19052025-01-07T05:08:52.287ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19062025-01-07T05:08:52.287ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4
19072025-01-07T05:08:52.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19082025-01-07T05:08:52.307ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb670df5-eb06-4537-8ba0-b5be2520f226
19092025-01-07T05:08:52.326ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19102025-01-07T05:08:52.329ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f
19112025-01-07T05:08:52.346ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19122025-01-07T05:08:52.346ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_feb9b757-126c-48f6-9509-1209dc404e30
19132025-01-07T05:08:52.365ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19142025-01-07T05:08:52.365ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2
19152025-01-07T05:08:52.386ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19162025-01-07T05:08:52.386ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c
19172025-01-07T05:08:52.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44548 req_id = fa8befdc-fa02-40b6-a20c-56b3626353c3 response_code = 200 uri = /inventory
19182025-01-07T05:08:56.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52092
19192025-01-07T05:08:56.725ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19202025-01-07T05:08:56.725ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19212025-01-07T05:08:56.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19222025-01-07T05:08:56.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19232025-01-07T05:08:56.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19242025-01-07T05:08:56.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19252025-01-07T05:08:56.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19262025-01-07T05:08:56.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52092 req_id = b3c23b1a-6bb5-41f0-9f4a-d938bb5a0530 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19272025-01-07T05:08:56.727ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
19282025-01-07T05:08:56.732ZINFOSledAgent (RSS): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19292025-01-07T05:08:56.732ZINFOSledAgent (RSS): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19302025-01-07T05:08:57.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54610
19312025-01-07T05:08:57.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19322025-01-07T05:08:57.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19332025-01-07T05:08:57.135ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:177
19342025-01-07T05:08:57.135ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:177
19352025-01-07T05:08:57.148ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19362025-01-07T05:08:57.148ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5bbe57c7-cdff-41cb-8e81-937c370da161
19372025-01-07T05:08:57.172ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19382025-01-07T05:08:57.172ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5
19392025-01-07T05:08:57.196ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19402025-01-07T05:08:57.196ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ec06319-8348-4c49-b606-b9eed234158a
19412025-01-07T05:08:57.218ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19422025-01-07T05:08:57.218ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4
19432025-01-07T05:08:57.240ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19442025-01-07T05:08:57.240ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb670df5-eb06-4537-8ba0-b5be2520f226
19452025-01-07T05:08:57.261ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19462025-01-07T05:08:57.261ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f
19472025-01-07T05:08:57.281ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19482025-01-07T05:08:57.281ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_feb9b757-126c-48f6-9509-1209dc404e30
19492025-01-07T05:08:57.300ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19502025-01-07T05:08:57.300ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2
19512025-01-07T05:08:57.319ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19522025-01-07T05:08:57.319ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c
19532025-01-07T05:08:57.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195934 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54610 req_id = 4cfce14e-147e-4313-af52-b294a2be5300 response_code = 200 uri = /inventory
19542025-01-07T05:08:57.696ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63341
19552025-01-07T05:08:57.696ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63341 req_id = 39d932b4-f5c8-4b14-a09a-f6ab60aa447d response_code = 200 uri = /baseboard
19562025-01-07T05:08:57.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60121
19572025-01-07T05:08:57.780ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19582025-01-07T05:08:57.780ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19592025-01-07T05:08:57.780ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19602025-01-07T05:08:57.780ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19612025-01-07T05:08:57.780ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19622025-01-07T05:08:57.780ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19632025-01-07T05:08:57.780ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19642025-01-07T05:08:57.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60121 req_id = 0495a4dd-131b-4bf1-8cb8-c18fc7f09d9a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19652025-01-07T05:08:58.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43534
19662025-01-07T05:08:58.308ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19672025-01-07T05:08:58.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19682025-01-07T05:08:58.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19692025-01-07T05:08:58.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19702025-01-07T05:08:58.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19712025-01-07T05:08:58.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19722025-01-07T05:08:58.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19732025-01-07T05:08:58.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43534 req_id = 545b2d4e-78d0-4587-8712-bb69bb18040e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19742025-01-07T05:08:58.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59498
19752025-01-07T05:08:58.487ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19762025-01-07T05:08:58.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19772025-01-07T05:08:58.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19782025-01-07T05:08:58.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19792025-01-07T05:08:58.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19802025-01-07T05:08:58.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19812025-01-07T05:08:58.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19822025-01-07T05:08:58.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59498 req_id = bd973c58-f561-4572-964b-bfad17c84e98 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19832025-01-07T05:09:05.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52563
19842025-01-07T05:09:05.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52563 req_id = 1ccf714a-3b4b-4a63-9a84-eaf9d83f3511 response_code = 200 uri = /vpc-routes
19852025-01-07T05:09:05.500ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
19862025-01-07T05:09:05.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52563 req_id = 00b72e64-357b-423a-871b-538dd32075ca response_code = 204 uri = /eip-gateways
19872025-01-07T05:09:05.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52563 req_id = d94223a7-2075-4dbd-986d-a1b4073463fa response_code = 204 uri = /vpc-routes
19882025-01-07T05:09:08.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53189
19892025-01-07T05:09:08.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53189 req_id = f9991895-06e0-4495-973a-d19a60038bfa response_code = 200 uri = /vpc-routes
19902025-01-07T05:09:08.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47156
19912025-01-07T05:09:08.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 616 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47156 req_id = e3c2066d-a222-41e3-b737-c31112ed4e5d response_code = 200 uri = /v2p
19922025-01-07T05:09:08.695ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
19932025-01-07T05:09:08.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53189 req_id = fa1a1634-f2cd-4bca-948a-55e5d15fc649 response_code = 204 uri = /eip-gateways
19942025-01-07T05:09:08.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53189 req_id = fd6db887-35a7-4a02-b628-55e65e177d3d response_code = 204 uri = /vpc-routes
19952025-01-07T05:09:08.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44170
19962025-01-07T05:09:08.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44170 req_id = e236835c-3767-4c6f-951a-8d3526760926 response_code = 200 uri = /vpc-routes
19972025-01-07T05:09:08.958ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
19982025-01-07T05:09:08.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44170 req_id = af0de9b1-5193-4b38-b5e9-dc1236898bd6 response_code = 204 uri = /eip-gateways
19992025-01-07T05:09:09.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34117
20002025-01-07T05:09:09.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34117 req_id = 17400530-849a-4eac-b4e4-6892f17100ed response_code = 200 uri = /v2p
20012025-01-07T05:09:09.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44170 req_id = 6dd2df09-6f38-419b-8fa4-b95f318c8c22 response_code = 204 uri = /vpc-routes
20022025-01-07T05:09:09.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46107
20032025-01-07T05:09:09.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20042025-01-07T05:09:09.099ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20052025-01-07T05:09:09.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152824 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46107 req_id = 59ebc470-505f-4071-bb42-54f139476a9d response_code = 204 uri = /switch-ports
20062025-01-07T05:09:09.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40922
20072025-01-07T05:09:09.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40922 req_id = 337651cb-2dc0-47b7-a434-e3441c3066e8 response_code = 200 uri = /vpc-routes
20082025-01-07T05:09:09.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46107 req_id = b53d7eda-9009-4cd3-af57-726da853ff9e response_code = 200 uri = /network-bootstore-config
20092025-01-07T05:09:09.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
20102025-01-07T05:09:09.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40922 req_id = 488dd1f5-adb9-4a4a-b2a7-1b7236534fb3 response_code = 204 uri = /eip-gateways
20112025-01-07T05:09:09.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55457
20122025-01-07T05:09:09.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55457 req_id = 05d3a303-6d33-432c-89fb-391d2fb6f75a response_code = 200 uri = /v2p
20132025-01-07T05:09:09.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40922 req_id = 0f6df658-878d-4ef8-976a-f6c1b434ab49 response_code = 204 uri = /vpc-routes
20142025-01-07T05:09:09.322ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
20152025-01-07T05:09:09.323ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20162025-01-07T05:09:09.324ZINFOSledAgent (bootstore): Writing ledger to /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20172025-01-07T05:09:09.325ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
20182025-01-07T05:09:09.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4702 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46107 req_id = 1a873ffd-0bca-4db3-aee9-75343f2ab972 response_code = 204 uri = /network-bootstore-config
20192025-01-07T05:09:09.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54607
20202025-01-07T05:09:09.394ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20212025-01-07T05:09:09.433ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20222025-01-07T05:09:09.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94073 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54607 req_id = 623535ea-6034-428e-9cb3-2743c3b6e70a response_code = 204 uri = /switch-ports
20232025-01-07T05:09:09.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54607 req_id = 31500a66-7c4e-4fec-bb12-7bf0648da8de response_code = 200 uri = /network-bootstore-config
20242025-01-07T05:09:09.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52153
20252025-01-07T05:09:09.557ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20262025-01-07T05:09:09.593ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20272025-01-07T05:09:09.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52153 req_id = 5b6b753a-e61e-4398-90f3-7d0bc7dadcb7 response_code = 204 uri = /switch-ports
20282025-01-07T05:09:09.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52153 req_id = a28f34b2-8172-4c38-b6e0-a923e2a5fcb9 response_code = 200 uri = /network-bootstore-config
20292025-01-07T05:09:21.315ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6062 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 0c1dfaa6-793d-4790-989d-3c5d454d34f1 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
20302025-01-07T05:09:27.728ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58379
20312025-01-07T05:09:27.729ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58379 req_id = c813f656-1e27-4ca6-87d5-17ff6531db41 response_code = 200 uri = /baseboard
20322025-01-07T05:09:38.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58577
20332025-01-07T05:09:38.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58577 req_id = f39a2115-58f5-49db-8249-b8be1efe3031 response_code = 200 uri = /vpc-routes
20342025-01-07T05:09:38.556ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
20352025-01-07T05:09:38.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58577 req_id = 51b13c3e-9f73-4052-80f6-4e3fcf759e12 response_code = 204 uri = /eip-gateways
20362025-01-07T05:09:38.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58577 req_id = b4f05337-91d5-4d48-9755-b9f9a7169069 response_code = 204 uri = /vpc-routes
20372025-01-07T05:09:38.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39324
20382025-01-07T05:09:38.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20392025-01-07T05:09:38.671ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20402025-01-07T05:09:38.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101531 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39324 req_id = 868855e7-d9fb-40f0-bc6d-7ac4c26eea9d response_code = 204 uri = /switch-ports
20412025-01-07T05:09:38.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48331
20422025-01-07T05:09:38.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39324 req_id = c5e2a81a-0b3d-4541-b505-6b605ff5ee1d response_code = 200 uri = /network-bootstore-config
20432025-01-07T05:09:38.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48331 req_id = 2e9c85f3-4942-4de8-a3cc-fcea92ed558c response_code = 200 uri = /v2p
20442025-01-07T05:09:38.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62475
20452025-01-07T05:09:38.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62475 req_id = 501ad0fd-17aa-4e36-a3fd-88903cc7b6a3 response_code = 200 uri = /vpc-routes
20462025-01-07T05:09:38.812ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
20472025-01-07T05:09:38.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62475 req_id = 6e96c7ac-e881-4214-9fea-870fa469e945 response_code = 204 uri = /eip-gateways
20482025-01-07T05:09:38.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62475 req_id = a64f19ee-0398-47fe-99d2-0ce600d1b6cf response_code = 204 uri = /vpc-routes
20492025-01-07T05:09:38.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39158
20502025-01-07T05:09:38.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20512025-01-07T05:09:38.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20522025-01-07T05:09:38.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39158 req_id = c31d2f5c-6c5f-406c-bcd4-852f3430f602 response_code = 204 uri = /switch-ports
20532025-01-07T05:09:38.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61820
20542025-01-07T05:09:38.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48251
20552025-01-07T05:09:38.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61820 req_id = a3f2144a-1198-4daf-95d1-5058a9479511 response_code = 200 uri = /v2p
20562025-01-07T05:09:38.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39158 req_id = 5d21eed7-7cee-4f44-a047-e8008dbc5f3e response_code = 200 uri = /network-bootstore-config
20572025-01-07T05:09:38.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48251 req_id = c1b70dc9-778f-4a6d-a7b5-212348af632d response_code = 200 uri = /vpc-routes
20582025-01-07T05:09:38.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44386
20592025-01-07T05:09:38.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44386 req_id = a2aa3dd1-8c56-496c-9c90-a7e7338ad493 response_code = 200 uri = /v2p
20602025-01-07T05:09:38.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
20612025-01-07T05:09:38.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48251 req_id = 630c71d8-6b7e-4b39-939f-76add513a08c response_code = 204 uri = /eip-gateways
20622025-01-07T05:09:38.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48251 req_id = 6c89eb83-b367-47fa-81fc-0749250f5ecf response_code = 204 uri = /vpc-routes
20632025-01-07T05:09:39.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57483
20642025-01-07T05:09:39.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20652025-01-07T05:09:39.178ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20662025-01-07T05:09:39.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82417 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57483 req_id = f3e77c3f-4016-4628-a788-23506889ee1e response_code = 204 uri = /switch-ports
20672025-01-07T05:09:39.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57483 req_id = 4bb858a9-e90a-4784-9bdc-389c37fbe421 response_code = 200 uri = /network-bootstore-config
20682025-01-07T05:09:51.314ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6422 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 6d30435e-74c7-4ae4-b642-364686fb9d67 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
20692025-01-07T05:09:57.761ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46377
20702025-01-07T05:09:57.761ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46377 req_id = cd73b6c3-ca84-4a29-8017-934872d6b120 response_code = 200 uri = /baseboard
20712025-01-07T05:10:08.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32954
20722025-01-07T05:10:08.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32954 req_id = 7fe87bdf-1f99-4645-9180-bf94143d6e7d response_code = 200 uri = /vpc-routes
20732025-01-07T05:10:08.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34133
20742025-01-07T05:10:08.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34133 req_id = 222e666e-08d7-4b51-8283-6a65ab268843 response_code = 200 uri = /v2p
20752025-01-07T05:10:08.781ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
20762025-01-07T05:10:08.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32954 req_id = 07c7accf-ccea-4cdd-a1d8-8fb2021ed4ba response_code = 204 uri = /eip-gateways
20772025-01-07T05:10:08.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32954 req_id = 259c4807-9375-4609-ba83-62ffe6e7b17a response_code = 204 uri = /vpc-routes
20782025-01-07T05:10:08.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38114
20792025-01-07T05:10:08.976ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20802025-01-07T05:10:09.013ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20812025-01-07T05:10:09.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38114 req_id = cfbbde5d-9605-463e-abee-53a487a0e0db response_code = 204 uri = /switch-ports
20822025-01-07T05:10:09.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39092
20832025-01-07T05:10:09.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39092 req_id = 2a87e56a-4c47-444b-ba66-f90760152b96 response_code = 200 uri = /vpc-routes
20842025-01-07T05:10:09.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57549
20852025-01-07T05:10:09.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38114 req_id = ce715c8e-349b-428c-96e1-6367ab9572f8 response_code = 200 uri = /network-bootstore-config
20862025-01-07T05:10:09.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57549 req_id = c8b6a987-d529-490a-8d37-b07efacec6ee response_code = 200 uri = /vpc-routes
20872025-01-07T05:10:09.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44958
20882025-01-07T05:10:09.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44958 req_id = 2d65161f-c724-457a-917d-30c8758607b5 response_code = 200 uri = /v2p
20892025-01-07T05:10:09.118ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
20902025-01-07T05:10:09.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57549 req_id = 3fb68063-3134-40cb-a4bb-2030b6a91035 response_code = 204 uri = /eip-gateways
20912025-01-07T05:10:09.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
20922025-01-07T05:10:09.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39092 req_id = 46fa6a68-d149-4df7-8392-ce45168de4a1 response_code = 204 uri = /eip-gateways
20932025-01-07T05:10:09.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39092 req_id = 8db88baf-f416-4a63-a35e-bb5836ad9dc8 response_code = 204 uri = /vpc-routes
20942025-01-07T05:10:09.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64233
20952025-01-07T05:10:09.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64233 req_id = 21ebbfe4-fd44-46a7-9850-ae6a8d7756a2 response_code = 200 uri = /v2p
20962025-01-07T05:10:09.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57549 req_id = 97ea1350-d15e-4776-9be8-3103fde9c209 response_code = 204 uri = /vpc-routes
20972025-01-07T05:10:09.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55204
20982025-01-07T05:10:09.379ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20992025-01-07T05:10:09.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21002025-01-07T05:10:09.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94629 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55204 req_id = d5cfae44-04b5-4805-ae38-ff72313e6e00 response_code = 204 uri = /switch-ports
21012025-01-07T05:10:09.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39125
21022025-01-07T05:10:09.474ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21032025-01-07T05:10:09.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55204 req_id = 616ce44f-062c-4c55-a25c-dfd3bcbe2a06 response_code = 200 uri = /network-bootstore-config
21042025-01-07T05:10:09.508ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21052025-01-07T05:10:09.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39125 req_id = 9a50838d-8a52-4bec-a0e1-a950f35b8305 response_code = 204 uri = /switch-ports
21062025-01-07T05:10:09.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39125 req_id = 17b1f781-958a-4c71-afe9-4f4330cd681d response_code = 200 uri = /network-bootstore-config
21072025-01-07T05:10:21.125ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21082025-01-07T05:10:21.315ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7093 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 54435a09-9d38-4ddc-a272-2075b58540b8 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
21092025-01-07T05:10:27.794ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34819
21102025-01-07T05:10:27.794ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34819 req_id = b91c9c51-78ab-4d5a-878b-c547b3766e26 response_code = 200 uri = /baseboard
21112025-01-07T05:10:38.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34020
21122025-01-07T05:10:38.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34020 req_id = 2769d990-00ff-4fa7-8996-89d31a267eed response_code = 200 uri = /vpc-routes
21132025-01-07T05:10:38.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
21142025-01-07T05:10:38.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34020 req_id = 2c41d5dd-0607-41ad-b658-1ca12951437d response_code = 204 uri = /eip-gateways
21152025-01-07T05:10:38.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34020 req_id = 4212ca03-0ca7-4fec-a75d-e589a8aa85ee response_code = 204 uri = /vpc-routes
21162025-01-07T05:10:38.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61694
21172025-01-07T05:10:38.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61694 req_id = 262d9418-f6ed-4cc8-a25c-2989c2939f99 response_code = 200 uri = /v2p
21182025-01-07T05:10:38.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52592
21192025-01-07T05:10:38.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52592 req_id = c19d5389-d05f-40a7-87e8-e71fd8202165 response_code = 200 uri = /vpc-routes
21202025-01-07T05:10:38.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59381
21212025-01-07T05:10:38.655ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21222025-01-07T05:10:38.698ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21232025-01-07T05:10:38.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59381 req_id = dfaea8bc-d3ac-4d17-a8c3-0e8ffdc49544 response_code = 204 uri = /switch-ports
21242025-01-07T05:10:38.776ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
21252025-01-07T05:10:38.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52592 req_id = e053990d-b6fb-41a1-897a-3c9b8b5fa9b1 response_code = 204 uri = /eip-gateways
21262025-01-07T05:10:38.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59381 req_id = 3b6588e4-ec54-43dc-b5a2-44acfe525b08 response_code = 200 uri = /network-bootstore-config
21272025-01-07T05:10:38.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52592 req_id = f8f2c912-fce6-4fb6-a283-d6ffe5294e7b response_code = 204 uri = /vpc-routes
21282025-01-07T05:10:38.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52306
21292025-01-07T05:10:38.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52306 req_id = f6f385c0-123a-466b-b996-d10c4853b536 response_code = 200 uri = /v2p
21302025-01-07T05:10:38.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49340
21312025-01-07T05:10:38.890ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21322025-01-07T05:10:38.923ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21332025-01-07T05:10:38.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49340 req_id = 3db2d411-7f42-4414-ba9b-1578183bc907 response_code = 204 uri = /switch-ports
21342025-01-07T05:10:38.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49340 req_id = a1490f7f-e331-400f-8deb-10a4c0c70577 response_code = 200 uri = /network-bootstore-config
21352025-01-07T05:10:39.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60129
21362025-01-07T05:10:39.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60129 req_id = d890b114-864c-4140-b742-ff8a5fef65a8 response_code = 200 uri = /vpc-routes
21372025-01-07T05:10:39.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39326
21382025-01-07T05:10:39.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39326 req_id = 650838a0-1d9b-4157-a330-9da73d1ba8d3 response_code = 200 uri = /v2p
21392025-01-07T05:10:39.076ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
21402025-01-07T05:10:39.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60129 req_id = aadb445c-3289-4cca-9f12-5955dae18d52 response_code = 204 uri = /eip-gateways
21412025-01-07T05:10:39.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60129 req_id = 352fb639-1bf9-4647-9253-a1a7640f09ad response_code = 204 uri = /vpc-routes
21422025-01-07T05:10:39.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59481
21432025-01-07T05:10:39.171ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21442025-01-07T05:10:39.208ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21452025-01-07T05:10:39.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88717 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59481 req_id = 285c0756-63f9-4422-ab6e-bc3aa0f656e4 response_code = 204 uri = /switch-ports
21462025-01-07T05:10:39.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59481 req_id = bf072e03-e884-4e8d-bf47-418cd7d3ee78 response_code = 200 uri = /network-bootstore-config
21472025-01-07T05:10:51.314ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7004 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 85a28f2c-2d6f-4528-b5bf-c2fcd0930b92 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
21482025-01-07T05:10:57.826ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47418
21492025-01-07T05:10:57.826ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47418 req_id = 14d9ab43-b847-46d0-9189-d255da0accbc response_code = 200 uri = /baseboard
21502025-01-07T05:11:08.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48246
21512025-01-07T05:11:08.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48246 req_id = 57fa36b7-8a70-488c-9ffa-e8f35bfddea5 response_code = 200 uri = /vpc-routes
21522025-01-07T05:11:08.717ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
21532025-01-07T05:11:08.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48246 req_id = 2a71c2e2-9e5f-4c19-9fb2-8611bdd2056a response_code = 204 uri = /eip-gateways
21542025-01-07T05:11:08.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44198
21552025-01-07T05:11:08.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44198 req_id = 0a476af6-2161-4773-b5bd-d11ca8562796 response_code = 200 uri = /v2p
21562025-01-07T05:11:08.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48246 req_id = 72857363-4d01-4af1-811f-dfc469db335e response_code = 204 uri = /vpc-routes
21572025-01-07T05:11:08.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39888
21582025-01-07T05:11:08.913ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21592025-01-07T05:11:08.951ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21602025-01-07T05:11:09.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96658 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39888 req_id = fa45bf30-208e-48b7-8471-1b48c2850f60 response_code = 204 uri = /switch-ports
21612025-01-07T05:11:09.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41150
21622025-01-07T05:11:09.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41150 req_id = e446f527-76b8-464c-8b35-44da4c2d8469 response_code = 200 uri = /vpc-routes
21632025-01-07T05:11:09.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39888 req_id = 31ac0996-8f69-43dc-b792-37a2806f9a04 response_code = 200 uri = /network-bootstore-config
21642025-01-07T05:11:09.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
21652025-01-07T05:11:09.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41150 req_id = 858f914e-ecf9-4e9f-877e-00d7164686e7 response_code = 204 uri = /eip-gateways
21662025-01-07T05:11:09.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41150 req_id = a6e6228c-2d37-4a80-9224-40092ecbb139 response_code = 204 uri = /vpc-routes
21672025-01-07T05:11:09.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34606
21682025-01-07T05:11:09.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34606 req_id = 4a5883d5-b773-4a6a-a6a6-696aa88d655e response_code = 200 uri = /vpc-routes
21692025-01-07T05:11:09.168ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
21702025-01-07T05:11:09.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34606 req_id = 95af4420-cd00-41aa-80dd-9b7cacc6c9de response_code = 204 uri = /eip-gateways
21712025-01-07T05:11:09.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34606 req_id = 9f8c3197-577c-4999-aa03-142d59df9aff response_code = 204 uri = /vpc-routes
21722025-01-07T05:11:09.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64080
21732025-01-07T05:11:09.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64080 req_id = 9c6a5fac-5b78-4b32-a71b-cfa00bbb085d response_code = 200 uri = /v2p
21742025-01-07T05:11:09.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50769
21752025-01-07T05:11:09.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21762025-01-07T05:11:09.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21772025-01-07T05:11:09.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50769 req_id = 1f77497e-d90f-4cbf-aee6-9448542d8137 response_code = 204 uri = /switch-ports
21782025-01-07T05:11:09.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38479
21792025-01-07T05:11:09.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38479 req_id = d49f7077-f594-484b-b20d-1f982064ab27 response_code = 200 uri = /v2p
21802025-01-07T05:11:09.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50769 req_id = bf5eb5e4-5415-4d8c-aa18-46732764f89f response_code = 200 uri = /network-bootstore-config
21812025-01-07T05:11:09.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56856
21822025-01-07T05:11:09.335ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21832025-01-07T05:11:09.369ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21842025-01-07T05:11:09.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84689 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56856 req_id = 33c9e7f4-ac5a-4571-9555-22c8115486ad response_code = 204 uri = /switch-ports
21852025-01-07T05:11:09.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56856 req_id = 767f515b-10c2-4d1d-ae46-92aad5e9a273 response_code = 200 uri = /network-bootstore-config
21862025-01-07T05:11:21.314ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6525 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = d673e38b-17c3-405f-b585-51333665191e response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
21872025-01-07T05:11:27.859ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51442
21882025-01-07T05:11:27.860ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51442 req_id = f5996603-1407-4a22-90d8-8794e227a180 response_code = 200 uri = /baseboard
21892025-01-07T05:11:38.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53462
21902025-01-07T05:11:38.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53462 req_id = 20e9fe89-483c-4f0a-a3e3-7c60900efd61 response_code = 200 uri = /vpc-routes
21912025-01-07T05:11:38.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
21922025-01-07T05:11:38.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53462 req_id = 0378eba7-e512-466a-b397-de2a87006be2 response_code = 204 uri = /eip-gateways
21932025-01-07T05:11:38.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53462 req_id = 81f67fc8-dd35-4aca-a648-4e0ba9e9802f response_code = 204 uri = /vpc-routes
21942025-01-07T05:11:38.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39989
21952025-01-07T05:11:38.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39989 req_id = b2013844-1a76-46cc-bed8-bb840ef63870 response_code = 200 uri = /v2p
21962025-01-07T05:11:38.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46212
21972025-01-07T05:11:38.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21982025-01-07T05:11:38.709ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21992025-01-07T05:11:38.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118782 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46212 req_id = 95fcaf5a-6eab-460a-927b-5c810141fdee response_code = 204 uri = /switch-ports
22002025-01-07T05:11:38.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44735
22012025-01-07T05:11:38.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44735 req_id = 82d2f8dd-8a60-4cd5-8ae1-039eca518f22 response_code = 200 uri = /vpc-routes
22022025-01-07T05:11:38.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46212 req_id = 27ee378f-f1c2-4d24-ad57-dbc2d03e9b9c response_code = 200 uri = /network-bootstore-config
22032025-01-07T05:11:38.835ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
22042025-01-07T05:11:38.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44735 req_id = 1ed9346a-269a-4bac-81ac-936dd0af9cf4 response_code = 204 uri = /eip-gateways
22052025-01-07T05:11:38.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51572
22062025-01-07T05:11:38.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51572 req_id = eac3ef05-1e18-4470-8a74-486d95bb993a response_code = 200 uri = /v2p
22072025-01-07T05:11:38.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44735 req_id = e18aecf4-782c-42c7-bb32-29c4e0f1c25c response_code = 204 uri = /vpc-routes
22082025-01-07T05:11:38.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42951
22092025-01-07T05:11:38.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42951 req_id = ed70ffa9-1000-4c06-b09a-900e7efb5c89 response_code = 200 uri = /vpc-routes
22102025-01-07T05:11:38.947ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
22112025-01-07T05:11:38.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42951 req_id = 5076581c-777c-45c9-b978-5b37840ffe90 response_code = 204 uri = /eip-gateways
22122025-01-07T05:11:38.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42951 req_id = c5583ae7-1919-4aa2-b120-5651513bf52f response_code = 204 uri = /vpc-routes
22132025-01-07T05:11:38.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57760
22142025-01-07T05:11:38.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22152025-01-07T05:11:39.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22162025-01-07T05:11:39.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106535 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57760 req_id = b06a2663-01ef-4daa-bf33-5938b4256797 response_code = 204 uri = /switch-ports
22172025-01-07T05:11:39.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46997
22182025-01-07T05:11:39.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35561
22192025-01-07T05:11:39.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57760 req_id = c594f715-f963-4471-b9b8-0d9633842ea6 response_code = 200 uri = /network-bootstore-config
22202025-01-07T05:11:39.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35561 req_id = 310d8a93-d841-499c-bfbf-f418809427e3 response_code = 200 uri = /v2p
22212025-01-07T05:11:39.087ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22222025-01-07T05:11:39.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22232025-01-07T05:11:39.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88105 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46997 req_id = f3bd16a2-12cf-4dc7-a66b-414034469b6f response_code = 204 uri = /switch-ports
22242025-01-07T05:11:39.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46997 req_id = 31fe6497-d61c-4914-86b4-5da52dbdbd1f response_code = 200 uri = /network-bootstore-config
22252025-01-07T05:11:51.313ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7117 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 4aa84e81-a666-4dd1-8c0e-7bf0f6283e81 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
22262025-01-07T05:11:57.892ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52011
22272025-01-07T05:11:57.892ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52011 req_id = ba18f2b1-5aa0-4180-a91f-76d8cdd1478d response_code = 200 uri = /baseboard
22282025-01-07T05:12:08.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53170
22292025-01-07T05:12:08.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53170 req_id = 09092257-73a3-4a6b-baad-41ba5854b8d7 response_code = 200 uri = /vpc-routes
22302025-01-07T05:12:08.706ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
22312025-01-07T05:12:08.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53170 req_id = 3a286176-854c-4adc-918b-2c6b78d93e0e response_code = 204 uri = /eip-gateways
22322025-01-07T05:12:08.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64316
22332025-01-07T05:12:08.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64316 req_id = 0292cae9-b126-4e44-b257-68e657ade23e response_code = 200 uri = /v2p
22342025-01-07T05:12:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53170 req_id = 18a05740-465c-44b7-83a8-33c55e8d1910 response_code = 204 uri = /vpc-routes
22352025-01-07T05:12:08.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56556
22362025-01-07T05:12:08.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22372025-01-07T05:12:08.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22382025-01-07T05:12:08.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126533 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56556 req_id = c0bbd864-ca76-4034-b576-158e53184a6c response_code = 204 uri = /switch-ports
22392025-01-07T05:12:08.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56556 req_id = a8f863f1-811c-48ca-b101-20097766c920 response_code = 200 uri = /network-bootstore-config
22402025-01-07T05:12:08.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52165
22412025-01-07T05:12:08.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52165 req_id = 0b6b5751-c1cc-455b-bc06-74dbcdc4a9fc response_code = 200 uri = /v2p
22422025-01-07T05:12:09.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38182
22432025-01-07T05:12:09.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38182 req_id = 06ed3971-d16b-40a8-8f67-0040f570a15e response_code = 200 uri = /vpc-routes
22442025-01-07T05:12:09.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
22452025-01-07T05:12:09.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38182 req_id = c8291546-1fe3-41e3-ab17-ea5a4a4ffcde response_code = 204 uri = /eip-gateways
22462025-01-07T05:12:09.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38182 req_id = 67b96bc3-f66e-4709-802e-4d98d046632f response_code = 204 uri = /vpc-routes
22472025-01-07T05:12:09.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64969
22482025-01-07T05:12:09.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64969 req_id = 7a2a7457-d2c5-41f3-acf4-817177987de6 response_code = 200 uri = /vpc-routes
22492025-01-07T05:12:09.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
22502025-01-07T05:12:09.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64969 req_id = 9bd0f810-c6ff-4760-9cff-e8d1c609dbd3 response_code = 204 uri = /eip-gateways
22512025-01-07T05:12:09.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64969 req_id = 7cb0c38a-7d1a-4bc8-8eed-a1ed8e56a0ad response_code = 204 uri = /vpc-routes
22522025-01-07T05:12:09.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48708
22532025-01-07T05:12:09.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48708 req_id = 109b877c-942e-49df-b60e-2ff1e2c3ff44 response_code = 200 uri = /v2p
22542025-01-07T05:12:09.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36624
22552025-01-07T05:12:09.200ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22562025-01-07T05:12:09.239ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22572025-01-07T05:12:09.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95887 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36624 req_id = 34b33b99-2d16-4ed4-ab79-4bc0d7e3eeb8 response_code = 204 uri = /switch-ports
22582025-01-07T05:12:09.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62574
22592025-01-07T05:12:09.296ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22602025-01-07T05:12:09.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22612025-01-07T05:12:09.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82880 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62574 req_id = 8f1a74f4-4f72-4d2d-99a6-327ed10e3f99 response_code = 204 uri = /switch-ports
22622025-01-07T05:12:09.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36624 req_id = 15a11207-11be-4b5d-929c-19264fbcf402 response_code = 200 uri = /network-bootstore-config
22632025-01-07T05:12:09.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62574 req_id = f0c8a0f8-5320-4b50-80e6-7a671b2c6b66 response_code = 200 uri = /network-bootstore-config
22642025-01-07T05:12:21.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6316 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = c82b9d1f-4dbc-4871-b2b6-5a04f5b2806c response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
22652025-01-07T05:12:27.925ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37903
22662025-01-07T05:12:27.925ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37903 req_id = 3e39ce93-d6ef-43f7-991c-0b7d444d327e response_code = 200 uri = /baseboard
22672025-01-07T05:12:38.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37530
22682025-01-07T05:12:38.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37530 req_id = d391e617-c765-4d07-bb29-a1f2180c0973 response_code = 200 uri = /vpc-routes
22692025-01-07T05:12:38.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
22702025-01-07T05:12:38.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37530 req_id = c45dafa6-ab12-4620-a669-7b9c9d9b7eaf response_code = 204 uri = /eip-gateways
22712025-01-07T05:12:38.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48393
22722025-01-07T05:12:38.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48393 req_id = 513fcda0-c8c1-4d4c-9145-57dab87a086e response_code = 200 uri = /v2p
22732025-01-07T05:12:38.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37530 req_id = 2a51ebb7-0dd5-4cec-a8d4-17b41be5c6a0 response_code = 204 uri = /vpc-routes
22742025-01-07T05:12:38.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46547
22752025-01-07T05:12:38.661ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22762025-01-07T05:12:38.700ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22772025-01-07T05:12:38.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121878 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46547 req_id = e185299a-1242-43c5-8e96-250ef820b56b response_code = 204 uri = /switch-ports
22782025-01-07T05:12:38.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46174
22792025-01-07T05:12:38.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46174 req_id = e2316ffa-b151-4304-87ce-98a6045c474a response_code = 200 uri = /vpc-routes
22802025-01-07T05:12:38.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46547 req_id = 3964360d-756d-4493-9a12-67f7bc251019 response_code = 200 uri = /network-bootstore-config
22812025-01-07T05:12:38.798ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
22822025-01-07T05:12:38.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46174 req_id = 699d21c1-6292-47ed-8b56-22ce3e76f356 response_code = 204 uri = /eip-gateways
22832025-01-07T05:12:38.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43585
22842025-01-07T05:12:38.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43585 req_id = 6c0bce7d-aef4-469f-8b23-dfb879b937c7 response_code = 200 uri = /vpc-routes
22852025-01-07T05:12:38.868ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
22862025-01-07T05:12:38.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43585 req_id = 05b561e7-9cd8-4a28-b61b-f50387737d09 response_code = 204 uri = /eip-gateways
22872025-01-07T05:12:38.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50743
22882025-01-07T05:12:38.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50743 req_id = 988e747d-c5c0-4d82-ac5a-aa5f90f5e51b response_code = 200 uri = /v2p
22892025-01-07T05:12:38.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43585 req_id = f0e0bc5c-5947-42b7-b4f9-459f1d787b26 response_code = 204 uri = /vpc-routes
22902025-01-07T05:12:38.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46174 req_id = b4e0dd27-7935-42f5-a79a-b11a9de4e1ea response_code = 204 uri = /vpc-routes
22912025-01-07T05:12:38.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38211
22922025-01-07T05:12:38.897ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22932025-01-07T05:12:38.936ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22942025-01-07T05:12:38.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94919 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38211 req_id = e8a45b09-ab6a-4d95-948b-a8eff082a63e response_code = 204 uri = /switch-ports
22952025-01-07T05:12:38.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47970
22962025-01-07T05:12:38.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38211 req_id = 72045f4b-475a-438f-a5b4-f80fcc5bb3c2 response_code = 200 uri = /network-bootstore-config
22972025-01-07T05:12:38.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47970 req_id = 744c014e-0358-4c74-a9f6-edd5684f9856 response_code = 200 uri = /v2p
22982025-01-07T05:12:39.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37700
22992025-01-07T05:12:39.027ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23002025-01-07T05:12:39.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23012025-01-07T05:12:39.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89863 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37700 req_id = c0282a4b-bcb3-4283-b808-1560b9894486 response_code = 204 uri = /switch-ports
23022025-01-07T05:12:39.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37700 req_id = 39018f1a-5ad2-407f-90b6-f468a17b2bc4 response_code = 200 uri = /network-bootstore-config
23032025-01-07T05:12:51.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6705 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = d937b665-3ef7-428f-9a30-5f6ac1d8bb29 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
23042025-01-07T05:12:57.958ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46216
23052025-01-07T05:12:57.958ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46216 req_id = 4f89110c-2b6f-47ed-9c13-1f6ce2122f5a response_code = 200 uri = /baseboard
23062025-01-07T05:13:08.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36527
23072025-01-07T05:13:08.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36527 req_id = f5c58e1d-04ef-457e-97f1-480c06c0b1ba response_code = 200 uri = /vpc-routes
23082025-01-07T05:13:08.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
23092025-01-07T05:13:08.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36527 req_id = c79b9180-9184-498d-89fa-32d4bceb346a response_code = 204 uri = /eip-gateways
23102025-01-07T05:13:08.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36527 req_id = 1b12c6c3-56f5-4e21-a116-ed9d30db9949 response_code = 204 uri = /vpc-routes
23112025-01-07T05:13:08.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49962
23122025-01-07T05:13:08.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23132025-01-07T05:13:08.929ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23142025-01-07T05:13:09.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126194 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49962 req_id = b25b8112-eb27-4e0c-9045-35dd56f5f922 response_code = 204 uri = /switch-ports
23152025-01-07T05:13:09.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57864
23162025-01-07T05:13:09.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61082
23172025-01-07T05:13:09.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50746
23182025-01-07T05:13:09.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49962 req_id = 3ef5e997-5afe-4a9e-86a0-51075f0e84ca response_code = 200 uri = /network-bootstore-config
23192025-01-07T05:13:09.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61082 req_id = 0976cbeb-df89-4dc9-b185-743b6f558aef response_code = 200 uri = /vpc-routes
23202025-01-07T05:13:09.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50746 req_id = 271031ff-f5e5-40f5-800d-10113411db13 response_code = 200 uri = /v2p
23212025-01-07T05:13:09.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57864 req_id = e6b60096-4860-4448-b331-06b4401efa7f response_code = 200 uri = /v2p
23222025-01-07T05:13:09.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
23232025-01-07T05:13:09.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61082 req_id = 4675b1c4-4945-4f3e-a65d-4793428cea75 response_code = 204 uri = /eip-gateways
23242025-01-07T05:13:09.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61082 req_id = e57c5eda-fb2d-494a-ba74-cee5cecf838f response_code = 204 uri = /vpc-routes
23252025-01-07T05:13:09.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40854
23262025-01-07T05:13:09.051ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23272025-01-07T05:13:09.099ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23282025-01-07T05:13:09.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40854 req_id = b17e83f2-1f9c-4def-acf7-bf72cd902e30 response_code = 204 uri = /switch-ports
23292025-01-07T05:13:09.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33972
23302025-01-07T05:13:09.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40854 req_id = 83d6c737-a09f-4117-8c67-381f1fe45b2a response_code = 200 uri = /network-bootstore-config
23312025-01-07T05:13:09.165ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23322025-01-07T05:13:09.165ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23332025-01-07T05:13:09.165ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23342025-01-07T05:13:09.165ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23352025-01-07T05:13:09.165ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23362025-01-07T05:13:09.165ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23372025-01-07T05:13:09.165ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23382025-01-07T05:13:09.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33972 req_id = 7dedbe11-3fa4-4de5-9dd3-c176439f0b01 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23392025-01-07T05:13:09.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57656
23402025-01-07T05:13:09.167ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23412025-01-07T05:13:09.167ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23422025-01-07T05:13:09.167ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23432025-01-07T05:13:09.167ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23442025-01-07T05:13:09.167ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23452025-01-07T05:13:09.167ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23462025-01-07T05:13:09.167ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23472025-01-07T05:13:09.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57656 req_id = 84da2a73-e68c-4a7d-8cd4-cac3f52ec8bf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23482025-01-07T05:13:09.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43627
23492025-01-07T05:13:09.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43627 req_id = 03af7efa-ecc1-48bf-805e-03843a69b20f response_code = 200 uri = /vpc-routes
23502025-01-07T05:13:09.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45568
23512025-01-07T05:13:09.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45568 req_id = 3f7477c7-753a-4d80-818c-94222bd96053 response_code = 200 uri = /v2p
23522025-01-07T05:13:09.226ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
23532025-01-07T05:13:09.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43627 req_id = 23de26ba-4f53-4a61-9a73-75762ff6f401 response_code = 204 uri = /eip-gateways
23542025-01-07T05:13:09.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43627 req_id = 7dcdba86-9c5d-4eed-9aa3-6e8b646f6f59 response_code = 204 uri = /vpc-routes
23552025-01-07T05:13:09.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38161
23562025-01-07T05:13:09.309ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23572025-01-07T05:13:09.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23582025-01-07T05:13:09.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38161 req_id = 7f487b4d-9c0d-40b1-8143-6d8249743e0f response_code = 204 uri = /switch-ports
23592025-01-07T05:13:09.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38161 req_id = 8cb3dc71-e13e-479a-9ead-5900b7ce09e8 response_code = 200 uri = /network-bootstore-config
23602025-01-07T05:13:09.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54976
23612025-01-07T05:13:09.478ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23622025-01-07T05:13:09.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23632025-01-07T05:13:09.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23642025-01-07T05:13:09.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23652025-01-07T05:13:09.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23662025-01-07T05:13:09.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23672025-01-07T05:13:09.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23682025-01-07T05:13:09.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54976 req_id = e75d3fec-97eb-4f3d-af2d-79da3f5266a1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23692025-01-07T05:13:21.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6366 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = bbdece11-7faa-45d2-95a2-b1d3e1d51a34 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
23702025-01-07T05:13:27.993ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36401
23712025-01-07T05:13:27.993ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36401 req_id = 93680bc7-3c0f-4f72-b1f8-b77b1c30f9a1 response_code = 200 uri = /baseboard
23722025-01-07T05:13:38.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39457
23732025-01-07T05:13:38.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39457 req_id = 58487422-e40f-42e3-8497-f67ed057dcb8 response_code = 200 uri = /vpc-routes
23742025-01-07T05:13:38.562ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
23752025-01-07T05:13:38.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39457 req_id = 216f0080-a5a5-4514-9b51-47108b74485c response_code = 204 uri = /eip-gateways
23762025-01-07T05:13:38.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39457 req_id = 151f6d7a-1411-4a3f-82fc-346b345f3ef5 response_code = 204 uri = /vpc-routes
23772025-01-07T05:13:38.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37474
23782025-01-07T05:13:38.610ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23792025-01-07T05:13:38.647ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23802025-01-07T05:13:38.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90612 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37474 req_id = ca6b886f-84f6-40e5-9299-ed245d38cb60 response_code = 204 uri = /switch-ports
23812025-01-07T05:13:38.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43183
23822025-01-07T05:13:38.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37474 req_id = 9baf6b2a-5668-41a5-9f8f-1788886a8701 response_code = 200 uri = /network-bootstore-config
23832025-01-07T05:13:38.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43183 req_id = 608970ef-d7ff-4edb-b9ac-145347c9ebc4 response_code = 200 uri = /v2p
23842025-01-07T05:13:38.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39510
23852025-01-07T05:13:38.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39510 req_id = 2510192e-e787-4b36-b8e3-bbd77a8c3616 response_code = 200 uri = /vpc-routes
23862025-01-07T05:13:38.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40709
23872025-01-07T05:13:38.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40709 req_id = 37bbf61a-157e-4da8-a20d-153a643fd932 response_code = 200 uri = /v2p
23882025-01-07T05:13:38.830ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
23892025-01-07T05:13:38.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39510 req_id = e67a9e89-6bc1-4809-b20b-4cab5746a271 response_code = 204 uri = /eip-gateways
23902025-01-07T05:13:38.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39510 req_id = 33b065aa-d615-4802-9817-c9351015a78d response_code = 204 uri = /vpc-routes
23912025-01-07T05:13:38.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58341
23922025-01-07T05:13:38.873ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23932025-01-07T05:13:38.912ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23942025-01-07T05:13:38.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91375 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58341 req_id = 02e7fe29-3229-44bd-83dc-ef4d9d9e3fcd response_code = 204 uri = /switch-ports
23952025-01-07T05:13:38.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58341 req_id = b651779e-f5aa-403b-81e2-b3f9ba149fcf response_code = 200 uri = /network-bootstore-config
23962025-01-07T05:13:38.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61110
23972025-01-07T05:13:38.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61110 req_id = 3934e048-7b54-45d9-8aff-866be92c572b response_code = 200 uri = /vpc-routes
23982025-01-07T05:13:39.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57947
23992025-01-07T05:13:39.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57947 req_id = 8c9be525-a073-4f68-9924-e905fba23c28 response_code = 200 uri = /v2p
24002025-01-07T05:13:39.046ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
24012025-01-07T05:13:39.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61110 req_id = 29129862-8df9-4e2f-94de-bc0ad5303ff9 response_code = 204 uri = /eip-gateways
24022025-01-07T05:13:39.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47570
24032025-01-07T05:13:39.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24042025-01-07T05:13:39.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24052025-01-07T05:13:39.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91378 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47570 req_id = d5af89c0-35db-40d0-9cda-265fea6c5e8f response_code = 204 uri = /switch-ports
24062025-01-07T05:13:39.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61110 req_id = 24ba8340-cab9-4439-b5d0-281ff3f6e76a response_code = 204 uri = /vpc-routes
24072025-01-07T05:13:39.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47570 req_id = 8df9cd73-1264-4437-8db9-93d951a1049b response_code = 200 uri = /network-bootstore-config
24082025-01-07T05:13:51.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6295 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 121c5390-6f1d-41fb-9bc7-bfe8e94838ee response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
24092025-01-07T05:13:58.027ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49245
24102025-01-07T05:13:58.027ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49245 req_id = 30c77467-bf9d-4c9b-ba5a-a320de326e75 response_code = 200 uri = /baseboard
24112025-01-07T05:14:08.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56793
24122025-01-07T05:14:08.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56793 req_id = 3600cef3-a499-4444-b173-81848567ef3f response_code = 200 uri = /v2p
24132025-01-07T05:14:08.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49008
24142025-01-07T05:14:08.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49008 req_id = b3c74c28-d9ac-44a8-9ba5-fb53cf4e75ee response_code = 200 uri = /vpc-routes
24152025-01-07T05:14:08.811ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
24162025-01-07T05:14:08.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49008 req_id = a213ac69-96e7-4797-9b94-bec98cfb1894 response_code = 204 uri = /eip-gateways
24172025-01-07T05:14:08.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49008 req_id = 24972244-bade-4e49-a083-5d9e7efe481b response_code = 204 uri = /vpc-routes
24182025-01-07T05:14:08.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55890
24192025-01-07T05:14:08.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55890 req_id = 57f40a81-a7e3-4f9c-bab9-651cb9a45a08 response_code = 200 uri = /v2p
24202025-01-07T05:14:08.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59956
24212025-01-07T05:14:08.888ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24222025-01-07T05:14:08.930ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24232025-01-07T05:14:08.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59956 req_id = 8d84391a-f271-4f37-97c2-697d0ea3e897 response_code = 204 uri = /switch-ports
24242025-01-07T05:14:08.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56707
24252025-01-07T05:14:08.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56707 req_id = 933b3860-813d-4ef9-8c09-36c0ed2ded7d response_code = 200 uri = /vpc-routes
24262025-01-07T05:14:08.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59956 req_id = f0772ac1-d6d3-4363-80e6-e171f02749d6 response_code = 200 uri = /network-bootstore-config
24272025-01-07T05:14:09.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
24282025-01-07T05:14:09.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56707 req_id = 64a4f80c-a5ae-449d-8465-665a85cf50fc response_code = 204 uri = /eip-gateways
24292025-01-07T05:14:09.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56707 req_id = ee9ca5fb-edbc-4b49-847f-656c202821d2 response_code = 204 uri = /vpc-routes
24302025-01-07T05:14:09.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40970
24312025-01-07T05:14:09.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40970 req_id = e9800c70-6f4a-4693-b4d1-9ab3b7990438 response_code = 200 uri = /vpc-routes
24322025-01-07T05:14:09.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59232
24332025-01-07T05:14:09.078ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24342025-01-07T05:14:09.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24352025-01-07T05:14:09.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95638 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59232 req_id = 081fb222-d85b-4059-8b70-cc5ee0514ee3 response_code = 204 uri = /switch-ports
24362025-01-07T05:14:09.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62812
24372025-01-07T05:14:09.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
24382025-01-07T05:14:09.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3916 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40970 req_id = 3912f813-0817-41bd-b7ef-f7aa2c93396e response_code = 204 uri = /eip-gateways
24392025-01-07T05:14:09.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62812 req_id = e90a68bf-745a-4338-9c46-09648dfcc3ef response_code = 200 uri = /v2p
24402025-01-07T05:14:09.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59232 req_id = 2f2a8f88-3cf1-41e7-b957-15d515700623 response_code = 200 uri = /network-bootstore-config
24412025-01-07T05:14:09.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47009
24422025-01-07T05:14:09.188ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24432025-01-07T05:14:09.225ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24442025-01-07T05:14:09.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95582 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47009 req_id = b78709ac-409c-41b4-95fd-5ca20ee8cea3 response_code = 204 uri = /switch-ports
24452025-01-07T05:14:09.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47009 req_id = 65d7eac0-62a9-4205-b7f9-bb8db6b538e6 response_code = 200 uri = /network-bootstore-config
24462025-01-07T05:14:09.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40970 req_id = ce065f88-2937-4772-a527-3686535f5c47 response_code = 204 uri = /vpc-routes
24472025-01-07T05:14:21.311ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6404 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 2231eac6-b05f-43f3-9933-941244400a0f response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
24482025-01-07T05:14:28.058ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60911
24492025-01-07T05:14:28.058ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60911 req_id = 8646e44d-8c92-4080-85de-0024dcf5b2c4 response_code = 200 uri = /baseboard
24502025-01-07T05:14:38.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56254
24512025-01-07T05:14:38.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56254 req_id = 8404c944-f1eb-48d1-8bee-de56dd34fa4c response_code = 200 uri = /v2p
24522025-01-07T05:14:38.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50479
24532025-01-07T05:14:38.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50479 req_id = 33b011c9-6c6f-44f0-aee1-e33deca6cc49 response_code = 200 uri = /vpc-routes
24542025-01-07T05:14:38.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
24552025-01-07T05:14:38.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50479 req_id = cdf6eccd-dad4-410f-95f3-e6bd852b5b7d response_code = 204 uri = /eip-gateways
24562025-01-07T05:14:38.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58472
24572025-01-07T05:14:38.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58472 req_id = 4a95a1a0-a931-41d7-9562-4a36e6a60d2e response_code = 200 uri = /vpc-routes
24582025-01-07T05:14:38.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36434
24592025-01-07T05:14:38.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36434 req_id = 3c94a974-7266-4f98-8dac-42f2c0bd1967 response_code = 200 uri = /v2p
24602025-01-07T05:14:38.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50479 req_id = e1f77f8d-8d07-4800-831b-9c8de162edd9 response_code = 204 uri = /vpc-routes
24612025-01-07T05:14:38.808ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
24622025-01-07T05:14:38.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58472 req_id = 6b4a1d3d-c6f6-4603-8d78-18c87422ffd4 response_code = 204 uri = /eip-gateways
24632025-01-07T05:14:38.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58472 req_id = 226fe048-ddff-400f-a7e9-7ac6efaee4f6 response_code = 204 uri = /vpc-routes
24642025-01-07T05:14:38.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53459
24652025-01-07T05:14:38.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24662025-01-07T05:14:38.865ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24672025-01-07T05:14:38.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53459 req_id = 2c6ff4f2-01c2-42d9-aefa-1b0e6f6eb4cc response_code = 204 uri = /switch-ports
24682025-01-07T05:14:38.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41028
24692025-01-07T05:14:38.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53459 req_id = df70a4b6-6271-4446-bd7e-a818eae0e419 response_code = 200 uri = /network-bootstore-config
24702025-01-07T05:14:38.920ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24712025-01-07T05:14:38.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64361
24722025-01-07T05:14:38.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64361 req_id = 1b872c10-0391-4537-8fc7-172b2accd09a response_code = 200 uri = /vpc-routes
24732025-01-07T05:14:38.960ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24742025-01-07T05:14:38.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
24752025-01-07T05:14:38.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64361 req_id = f6a1a92f-6669-475b-99c2-706a14c371c7 response_code = 204 uri = /eip-gateways
24762025-01-07T05:14:39.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64361 req_id = 839ddf01-2c6d-42a3-be74-edf2f86bd1b2 response_code = 204 uri = /vpc-routes
24772025-01-07T05:14:39.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38715
24782025-01-07T05:14:39.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38715 req_id = 2849ff6c-cc8a-49a0-8728-7a80cd8d4468 response_code = 200 uri = /v2p
24792025-01-07T05:14:39.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41028 req_id = 6c79b03b-2ad6-43d9-b946-96d9f0544c1b response_code = 204 uri = /switch-ports
24802025-01-07T05:14:39.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41028 req_id = 2eb50fa7-0e92-4296-8289-762c22c608a1 response_code = 200 uri = /network-bootstore-config
24812025-01-07T05:14:39.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42831
24822025-01-07T05:14:39.045ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24832025-01-07T05:14:39.082ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24842025-01-07T05:14:39.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90356 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42831 req_id = 73506d22-a89f-4ad2-82be-a26774b54c29 response_code = 204 uri = /switch-ports
24852025-01-07T05:14:39.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42831 req_id = 67ab3bd7-8d6c-4300-a4e7-0a11f574649e response_code = 200 uri = /network-bootstore-config
24862025-01-07T05:14:51.311ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6634 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 4acd1134-d737-455b-a45d-17bb2ce49ed8 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
24872025-01-07T05:14:58.091ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65085
24882025-01-07T05:14:58.091ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65085 req_id = f1c8c99a-2ee0-4ad3-88d9-a9eeafdbbfdd response_code = 200 uri = /baseboard
24892025-01-07T05:15:06.982ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24902025-01-07T05:15:06.983ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24912025-01-07T05:15:07.012ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 8160, tv_nsec: 571224070 } time_to_next_cleanup = 599.99999804s
24922025-01-07T05:15:08.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39293
24932025-01-07T05:15:08.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39293 req_id = fc894345-84e8-4446-b633-c24da1fa8b15 response_code = 200 uri = /vpc-routes
24942025-01-07T05:15:08.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
24952025-01-07T05:15:08.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39293 req_id = ea7c46e2-bb63-4f91-8817-a6fe8bfa654e response_code = 204 uri = /eip-gateways
24962025-01-07T05:15:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39293 req_id = da9eedb0-10f2-4615-9e9e-6395e62a7760 response_code = 204 uri = /vpc-routes
24972025-01-07T05:15:08.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62896
24982025-01-07T05:15:08.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62896 req_id = 17223b6c-260f-48fc-9900-7330c0a16d92 response_code = 200 uri = /v2p
24992025-01-07T05:15:08.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61930
25002025-01-07T05:15:08.867ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25012025-01-07T05:15:08.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25022025-01-07T05:15:08.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101023 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61930 req_id = 1424591e-6c9a-421d-9dde-6cb8d990d198 response_code = 204 uri = /switch-ports
25032025-01-07T05:15:08.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65079
25042025-01-07T05:15:08.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61930 req_id = fc174a59-42fa-4579-aedb-9a0d18af327f response_code = 200 uri = /network-bootstore-config
25052025-01-07T05:15:08.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65079 req_id = 4350a629-57da-44da-9e6f-70d299bae5c2 response_code = 200 uri = /v2p
25062025-01-07T05:15:08.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47555
25072025-01-07T05:15:08.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47555 req_id = 9d56ef56-9f32-40b7-9fa4-f49d03680d27 response_code = 200 uri = /vpc-routes
25082025-01-07T05:15:09.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
25092025-01-07T05:15:09.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47555 req_id = 8499415a-0052-420d-8ba6-72dd06e1079a response_code = 204 uri = /eip-gateways
25102025-01-07T05:15:09.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 880 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47555 req_id = 354ac562-1d03-495e-8a7b-1c4262fd4574 response_code = 204 uri = /vpc-routes
25112025-01-07T05:15:09.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41782
25122025-01-07T05:15:09.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41782 req_id = aa9b0c92-b127-4147-bc15-17c2a9569b15 response_code = 200 uri = /vpc-routes
25132025-01-07T05:15:09.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
25142025-01-07T05:15:09.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41782 req_id = dbe73da4-ce22-4029-bca8-424381e56877 response_code = 204 uri = /eip-gateways
25152025-01-07T05:15:09.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41782 req_id = 1a0f3253-980b-452d-aa9e-d37151da94c6 response_code = 204 uri = /vpc-routes
25162025-01-07T05:15:09.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34497
25172025-01-07T05:15:09.228ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25182025-01-07T05:15:09.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25192025-01-07T05:15:09.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93304 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34497 req_id = 29a6ea5b-1bab-40f8-8e52-28d425af92e8 response_code = 204 uri = /switch-ports
25202025-01-07T05:15:09.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63174
25212025-01-07T05:15:09.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63174 req_id = 2b35fa4a-7096-4b84-a4ed-770e3cd37c72 response_code = 200 uri = /v2p
25222025-01-07T05:15:09.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34497 req_id = 3eac2f8c-8f16-4d15-980c-36b87968731f response_code = 200 uri = /network-bootstore-config
25232025-01-07T05:15:09.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64516
25242025-01-07T05:15:09.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25252025-01-07T05:15:09.360ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25262025-01-07T05:15:09.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87714 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64516 req_id = 991ccc31-47b9-4394-837e-6492e043cffd response_code = 204 uri = /switch-ports
25272025-01-07T05:15:09.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64516 req_id = 5af183dd-d4f6-4cbc-9a23-d6b232d50553 response_code = 200 uri = /network-bootstore-config
25282025-01-07T05:15:21.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25292025-01-07T05:15:21.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8261 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = b919135c-8b4e-4b23-9649-5e9be2fbebf2 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
25302025-01-07T05:15:28.124ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43505
25312025-01-07T05:15:28.124ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43505 req_id = be60ae1e-d7cf-424b-9e68-84d7cc0867a0 response_code = 200 uri = /baseboard
25322025-01-07T05:15:38.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51043
25332025-01-07T05:15:38.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51043 req_id = c229edeb-8485-45d1-aa64-154947997010 response_code = 200 uri = /vpc-routes
25342025-01-07T05:15:38.577ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
25352025-01-07T05:15:38.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51043 req_id = 2027f58f-6dfc-4a57-8ce8-82a88e645e39 response_code = 204 uri = /eip-gateways
25362025-01-07T05:15:38.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51043 req_id = afa1ad49-df61-47c1-82c0-6cb718e56b16 response_code = 204 uri = /vpc-routes
25372025-01-07T05:15:38.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37628
25382025-01-07T05:15:38.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37628 req_id = 2dc0c0f1-868b-498c-9f4f-403f4ee7728e response_code = 200 uri = /v2p
25392025-01-07T05:15:38.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42019
25402025-01-07T05:15:38.655ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25412025-01-07T05:15:38.692ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25422025-01-07T05:15:38.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101768 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42019 req_id = 6ab2d375-21c6-4d71-87ea-f21764d05264 response_code = 204 uri = /switch-ports
25432025-01-07T05:15:38.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42019 req_id = 7dc4e000-7e49-4a1b-9fcf-cd31f567fa40 response_code = 200 uri = /network-bootstore-config
25442025-01-07T05:15:38.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45750
25452025-01-07T05:15:38.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45750 req_id = 946c96b2-e197-4260-85bc-ea3247dadbd6 response_code = 200 uri = /vpc-routes
25462025-01-07T05:15:38.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54379
25472025-01-07T05:15:38.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54379 req_id = 1d934bf4-ac63-4605-93b1-3cf314cead16 response_code = 200 uri = /vpc-routes
25482025-01-07T05:15:38.870ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
25492025-01-07T05:15:38.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45750 req_id = a77664db-5bbd-49bb-b4a1-71e8374a94cd response_code = 204 uri = /eip-gateways
25502025-01-07T05:15:38.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 427 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45750 req_id = f14ac7b5-bddf-412d-81de-9b8f2e469daf response_code = 204 uri = /vpc-routes
25512025-01-07T05:15:38.920ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
25522025-01-07T05:15:38.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54379 req_id = 23b6a86e-66ef-4a1e-8f24-9713aa363f0c response_code = 204 uri = /eip-gateways
25532025-01-07T05:15:38.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54379 req_id = ec35efbc-03a0-4082-9466-9180bf721bb2 response_code = 204 uri = /vpc-routes
25542025-01-07T05:15:38.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46300
25552025-01-07T05:15:38.940ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25562025-01-07T05:15:38.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25572025-01-07T05:15:39.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95841 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46300 req_id = 59bd83cf-409a-4a4d-96f2-216a9a029240 response_code = 204 uri = /switch-ports
25582025-01-07T05:15:39.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64860
25592025-01-07T05:15:39.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64860 req_id = ca648475-3e03-41a3-9155-db7f29a2d6c4 response_code = 200 uri = /v2p
25602025-01-07T05:15:39.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46300 req_id = ca534a8c-bb2a-4dfe-8d27-f2dda4f1c8b7 response_code = 200 uri = /network-bootstore-config
25612025-01-07T05:15:39.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58718
25622025-01-07T05:15:39.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58718 req_id = 1c109cc5-c214-4564-998f-0aad87dfd8a0 response_code = 200 uri = /v2p
25632025-01-07T05:15:39.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51022
25642025-01-07T05:15:39.100ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25652025-01-07T05:15:39.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25662025-01-07T05:15:39.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93222 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51022 req_id = 70caaa19-16e5-4b14-9ddf-6884473f5165 response_code = 204 uri = /switch-ports
25672025-01-07T05:15:39.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51022 req_id = 61cea349-9661-41c9-b10f-345646b8c83e response_code = 200 uri = /network-bootstore-config
25682025-01-07T05:15:51.311ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7171 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 855ebd27-2020-4588-9b78-2151a6f55975 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
25692025-01-07T05:15:58.155ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62760
25702025-01-07T05:15:58.155ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62760 req_id = 29030c03-8a0f-4d6f-a9bf-a17a3199f75c response_code = 200 uri = /baseboard
25712025-01-07T05:16:08.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54702
25722025-01-07T05:16:08.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54702 req_id = c73c4ad9-7780-499f-b1d8-865dc6b51f59 response_code = 200 uri = /vpc-routes
25732025-01-07T05:16:08.692ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
25742025-01-07T05:16:08.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54702 req_id = fa39570a-9137-4ddd-bfb1-533e372ecfd9 response_code = 204 uri = /eip-gateways
25752025-01-07T05:16:08.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54702 req_id = 6b230ea6-92af-4c4c-9381-15b4fc4a0fbc response_code = 204 uri = /vpc-routes
25762025-01-07T05:16:08.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33090
25772025-01-07T05:16:08.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33090 req_id = fdde7113-739c-41b0-af51-adf9c628ae31 response_code = 200 uri = /v2p
25782025-01-07T05:16:08.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38426
25792025-01-07T05:16:08.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38426 req_id = b564f66b-43d4-41a9-a5d7-f881ffac530e response_code = 200 uri = /vpc-routes
25802025-01-07T05:16:08.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58298
25812025-01-07T05:16:08.892ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25822025-01-07T05:16:08.934ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25832025-01-07T05:16:08.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103052 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58298 req_id = 524107c4-ccf3-48d0-b641-485a019c06e0 response_code = 204 uri = /switch-ports
25842025-01-07T05:16:08.995ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
25852025-01-07T05:16:08.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38426 req_id = def601d2-de9b-41d0-9793-f12c864d3cd6 response_code = 204 uri = /eip-gateways
25862025-01-07T05:16:08.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58298 req_id = c75f60cb-588f-461f-bcfd-ad4bad9e7405 response_code = 200 uri = /network-bootstore-config
25872025-01-07T05:16:08.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64855
25882025-01-07T05:16:08.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64855 req_id = 0de59ee1-d292-497e-98bc-f9fe0495dd63 response_code = 200 uri = /v2p
25892025-01-07T05:16:09.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38426 req_id = ae00f018-7064-4db5-980b-ae33756ae509 response_code = 204 uri = /vpc-routes
25902025-01-07T05:16:09.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50801
25912025-01-07T05:16:09.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50801 req_id = feb3d0d8-4c93-4de2-b243-04b43edb304a response_code = 200 uri = /vpc-routes
25922025-01-07T05:16:09.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36441
25932025-01-07T05:16:09.057ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25942025-01-07T05:16:09.098ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25952025-01-07T05:16:09.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36441 req_id = 9cf77cc5-4b75-43e9-8dec-7e478ec1d1c5 response_code = 204 uri = /switch-ports
25962025-01-07T05:16:09.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39095
25972025-01-07T05:16:09.163ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
25982025-01-07T05:16:09.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50801 req_id = 32b9bfe5-ab98-4fda-8128-edec856997ec response_code = 204 uri = /eip-gateways
25992025-01-07T05:16:09.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36441 req_id = c44c1972-5d5a-45c1-8d41-bebe1808d211 response_code = 200 uri = /network-bootstore-config
26002025-01-07T05:16:09.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26012025-01-07T05:16:09.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59040
26022025-01-07T05:16:09.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59040 req_id = b19763ea-a006-47e3-b8db-d4d1d48c0900 response_code = 200 uri = /v2p
26032025-01-07T05:16:09.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50801 req_id = f498ce14-e016-4bc9-9390-863986373f11 response_code = 204 uri = /vpc-routes
26042025-01-07T05:16:09.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26052025-01-07T05:16:09.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95943 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39095 req_id = 8c81572e-2e01-4dee-97da-93db63731e9f response_code = 204 uri = /switch-ports
26062025-01-07T05:16:09.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39095 req_id = 244eb4a5-d05d-4d74-9b78-e99de69cd741 response_code = 200 uri = /network-bootstore-config
26072025-01-07T05:16:21.311ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7702 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 226725a8-2ec3-4bea-b687-0b4bc2e431c4 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
26082025-01-07T05:16:28.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43913
26092025-01-07T05:16:28.188ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43913 req_id = 3944b2dc-8978-44cb-bd8a-d45626441aff response_code = 200 uri = /baseboard
26102025-01-07T05:16:38.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38131
26112025-01-07T05:16:38.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38131 req_id = e5fa35bd-cbe2-4cfe-b417-862ed24205c2 response_code = 200 uri = /vpc-routes
26122025-01-07T05:16:38.557ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
26132025-01-07T05:16:38.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38131 req_id = 2e8c8ea1-33bd-4bde-910f-28d2fa6d6fa7 response_code = 204 uri = /eip-gateways
26142025-01-07T05:16:38.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38131 req_id = ba9ce1b9-c6fb-4f0a-9add-2f0191ba2913 response_code = 204 uri = /vpc-routes
26152025-01-07T05:16:38.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59223
26162025-01-07T05:16:38.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59223 req_id = c54915b1-ab25-4a37-9ecc-2ac774c0845c response_code = 200 uri = /vpc-routes
26172025-01-07T05:16:38.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33322
26182025-01-07T05:16:38.658ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26192025-01-07T05:16:38.700ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26202025-01-07T05:16:38.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126555 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33322 req_id = 2224c562-7719-4466-88fd-ea0024036c98 response_code = 204 uri = /switch-ports
26212025-01-07T05:16:38.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41533
26222025-01-07T05:16:38.785ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
26232025-01-07T05:16:38.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47882
26242025-01-07T05:16:38.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59223 req_id = 5e3b5c36-9ba0-4126-8161-917a7d7c3243 response_code = 204 uri = /eip-gateways
26252025-01-07T05:16:38.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33322 req_id = 7be7796c-3245-40aa-9687-93a0938ac193 response_code = 200 uri = /network-bootstore-config
26262025-01-07T05:16:38.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26272025-01-07T05:16:38.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41533 req_id = ae143a2c-4c35-4c84-b735-8912d402fd07 response_code = 200 uri = /v2p
26282025-01-07T05:16:38.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 432 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59223 req_id = 7cdd3677-4bfd-4177-8af9-5dc19f2e2f47 response_code = 204 uri = /vpc-routes
26292025-01-07T05:16:38.840ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26302025-01-07T05:16:38.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50058
26312025-01-07T05:16:38.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50058 req_id = 80c0b572-dd2b-4ff4-b4e4-433f0c7c7b9b response_code = 200 uri = /v2p
26322025-01-07T05:16:38.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125721 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47882 req_id = c31d58c4-abc9-4088-abff-bc960a414b7f response_code = 204 uri = /switch-ports
26332025-01-07T05:16:38.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47882 req_id = e2adf9aa-ed95-4428-a207-0e23413cfb7e response_code = 200 uri = /network-bootstore-config
26342025-01-07T05:16:39.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34382
26352025-01-07T05:16:39.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34382 req_id = a30e5697-1363-496d-885d-07dd17cf1608 response_code = 200 uri = /vpc-routes
26362025-01-07T05:16:39.046ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
26372025-01-07T05:16:39.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34382 req_id = 171d281d-7850-428b-9ab2-56d56375619a response_code = 204 uri = /eip-gateways
26382025-01-07T05:16:39.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34382 req_id = eada5813-9dc7-45a3-9345-ff6c0cd34944 response_code = 204 uri = /vpc-routes
26392025-01-07T05:16:39.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52081
26402025-01-07T05:16:39.078ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26412025-01-07T05:16:39.113ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26422025-01-07T05:16:39.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52081 req_id = 21b4e086-a7bb-4cef-b48b-f0dd32751473 response_code = 204 uri = /switch-ports
26432025-01-07T05:16:39.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50954
26442025-01-07T05:16:39.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50954 req_id = 769c814c-dc57-48c9-be9e-4e60957803b9 response_code = 200 uri = /v2p
26452025-01-07T05:16:39.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52081 req_id = cceb9d37-904f-4950-8bf6-d6720ace4aeb response_code = 200 uri = /network-bootstore-config
26462025-01-07T05:16:51.310ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6885 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 50e0f43d-fb2a-4aef-aba6-fd1493be5f24 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
26472025-01-07T05:16:58.222ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55843
26482025-01-07T05:16:58.222ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55843 req_id = e20e8e92-77b0-4030-9df2-f1148849ab9e response_code = 200 uri = /baseboard
26492025-01-07T05:17:08.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47797
26502025-01-07T05:17:08.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47797 req_id = 624fe896-a697-4c05-9946-767f7da99b7a response_code = 200 uri = /vpc-routes
26512025-01-07T05:17:08.566ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
26522025-01-07T05:17:08.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47797 req_id = 7fba1e73-0e69-4e95-b345-7023c64931cd response_code = 204 uri = /eip-gateways
26532025-01-07T05:17:08.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47797 req_id = 3cecc94e-2eb2-42e5-bd9c-826bf6a15c8f response_code = 204 uri = /vpc-routes
26542025-01-07T05:17:08.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62821
26552025-01-07T05:17:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62821 req_id = 9d5f4562-08cd-44ea-ba93-87ed3000c32c response_code = 200 uri = /v2p
26562025-01-07T05:17:08.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34068
26572025-01-07T05:17:08.957ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26582025-01-07T05:17:08.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26592025-01-07T05:17:09.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101388 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34068 req_id = 762d4bbb-5f83-4fde-ad62-296308ce4e83 response_code = 204 uri = /switch-ports
26602025-01-07T05:17:09.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44946
26612025-01-07T05:17:09.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59847
26622025-01-07T05:17:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44946 req_id = da0ab284-215a-40c5-8943-503dc4899339 response_code = 200 uri = /vpc-routes
26632025-01-07T05:17:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34068 req_id = 45513bfa-d1b7-43f9-8a26-56917dc16634 response_code = 200 uri = /network-bootstore-config
26642025-01-07T05:17:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59847 req_id = b3a58dde-ac01-4108-9a20-7f461c16a7f8 response_code = 200 uri = /vpc-routes
26652025-01-07T05:17:09.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56416
26662025-01-07T05:17:09.068ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26672025-01-07T05:17:09.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61076
26682025-01-07T05:17:09.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61076 req_id = fa310b92-daa8-48b2-8a42-9fc13abd428e response_code = 200 uri = /v2p
26692025-01-07T05:17:09.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
26702025-01-07T05:17:09.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44946 req_id = 16a99c0d-a16a-4a75-ab1a-8e98d0152565 response_code = 204 uri = /eip-gateways
26712025-01-07T05:17:09.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
26722025-01-07T05:17:09.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59847 req_id = 624382f5-b800-4e80-90ac-3249acb89252 response_code = 204 uri = /eip-gateways
26732025-01-07T05:17:09.115ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26742025-01-07T05:17:09.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59847 req_id = f6834d93-0ac4-4a39-bcf6-c5c07d00d38d response_code = 204 uri = /vpc-routes
26752025-01-07T05:17:09.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44946 req_id = 6ad4608c-5078-4fd2-8558-533b06418546 response_code = 204 uri = /vpc-routes
26762025-01-07T05:17:09.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56416 req_id = 6ded1e16-1153-4f36-b70b-3a039ed86dc8 response_code = 204 uri = /switch-ports
26772025-01-07T05:17:09.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56416 req_id = f500ad61-6ebe-47e5-9a2f-f24bd01a9412 response_code = 200 uri = /network-bootstore-config
26782025-01-07T05:17:09.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59010
26792025-01-07T05:17:09.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59010 req_id = 690254ae-754b-4661-a879-d713260140e6 response_code = 200 uri = /v2p
26802025-01-07T05:17:09.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55992
26812025-01-07T05:17:09.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26822025-01-07T05:17:09.428ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26832025-01-07T05:17:09.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55992 req_id = 343afb3e-ac0e-43d9-822c-9df0dab91915 response_code = 204 uri = /switch-ports
26842025-01-07T05:17:09.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55992 req_id = 26fcb64d-0349-49c6-97ec-ed8a4cfb72ac response_code = 200 uri = /network-bootstore-config
26852025-01-07T05:17:21.310ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6965 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 4decdc29-9b0f-43c4-a8e9-7d165b79b272 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
26862025-01-07T05:17:28.255ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40377
26872025-01-07T05:17:28.255ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40377 req_id = 429b94d7-5f27-4438-8775-a79644cfb788 response_code = 200 uri = /baseboard
26882025-01-07T05:17:38.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41773
26892025-01-07T05:17:38.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41773 req_id = 601d205e-d33a-4ec2-93b2-d491dca60e30 response_code = 200 uri = /vpc-routes
26902025-01-07T05:17:38.562ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
26912025-01-07T05:17:38.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41773 req_id = b9e22d37-cb5b-4970-ac86-4881ceb08bce response_code = 204 uri = /eip-gateways
26922025-01-07T05:17:38.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43073
26932025-01-07T05:17:38.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43073 req_id = 4056e28b-3f9d-43d8-918c-34bdb8d65e76 response_code = 200 uri = /v2p
26942025-01-07T05:17:38.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41773 req_id = 89a27fa7-162e-4796-af6b-90f18513aa4a response_code = 204 uri = /vpc-routes
26952025-01-07T05:17:38.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51123
26962025-01-07T05:17:38.649ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26972025-01-07T05:17:38.686ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26982025-01-07T05:17:38.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51123 req_id = 05aa843e-2e3f-4b43-a702-34b5fd5db3c8 response_code = 204 uri = /switch-ports
26992025-01-07T05:17:38.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46002
27002025-01-07T05:17:38.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51123 req_id = 90a05949-a1fa-41d2-949e-a80d821e84be response_code = 200 uri = /network-bootstore-config
27012025-01-07T05:17:38.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46002 req_id = 00c92719-c104-415c-ad96-64bfa2c7c4bf response_code = 200 uri = /v2p
27022025-01-07T05:17:38.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53861
27032025-01-07T05:17:38.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53861 req_id = a499313b-59f6-4e9f-ac19-9620c53233e6 response_code = 200 uri = /vpc-routes
27042025-01-07T05:17:38.821ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
27052025-01-07T05:17:38.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53861 req_id = efd6fee7-eea8-4cb1-83d8-f56c32840c39 response_code = 204 uri = /eip-gateways
27062025-01-07T05:17:38.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53861 req_id = 71737011-ef7f-49ad-b72b-ff189394bf70 response_code = 204 uri = /vpc-routes
27072025-01-07T05:17:38.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39120
27082025-01-07T05:17:38.866ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27092025-01-07T05:17:38.901ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27102025-01-07T05:17:38.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39120 req_id = 5ab851ce-7eeb-407d-b5ef-2e7961160cea response_code = 204 uri = /switch-ports
27112025-01-07T05:17:38.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63044
27122025-01-07T05:17:38.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63044 req_id = d907c73b-cde7-437f-a7f0-dc674cb81a9e response_code = 200 uri = /vpc-routes
27132025-01-07T05:17:38.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39120 req_id = 9c872173-a4a4-4d68-b8de-f9dda66c9855 response_code = 200 uri = /network-bootstore-config
27142025-01-07T05:17:38.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54904
27152025-01-07T05:17:38.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54904 req_id = e038765f-94ae-4420-83dc-b2080d0a4ae5 response_code = 200 uri = /v2p
27162025-01-07T05:17:39.015ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
27172025-01-07T05:17:39.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63044 req_id = 2d26bae1-b44d-47c4-a7a5-b8ebe9125bb5 response_code = 204 uri = /eip-gateways
27182025-01-07T05:17:39.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63044 req_id = 4d0c3ac5-4e27-44b4-a880-9046a1d93e7b response_code = 204 uri = /vpc-routes
27192025-01-07T05:17:39.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61395
27202025-01-07T05:17:39.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27212025-01-07T05:17:39.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27222025-01-07T05:17:39.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89977 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61395 req_id = d2e673e7-99c0-445d-9aaa-67fd73e7f1e9 response_code = 204 uri = /switch-ports
27232025-01-07T05:17:39.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61395 req_id = 74d28bb6-fa82-4e46-a2ad-8b0b380895c7 response_code = 200 uri = /network-bootstore-config
27242025-01-07T05:17:51.309ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6478 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 9cb2041c-2b7d-40f8-8939-d013038731a7 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
27252025-01-07T05:17:58.288ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63013
27262025-01-07T05:17:58.288ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63013 req_id = d3a54d24-285c-4f62-b812-8293a67508f0 response_code = 200 uri = /baseboard
27272025-01-07T05:18:08.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41796
27282025-01-07T05:18:08.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41796 req_id = 2575ba87-a368-4bfd-8321-e8515e383f68 response_code = 200 uri = /vpc-routes
27292025-01-07T05:18:08.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
27302025-01-07T05:18:08.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41796 req_id = d2d41e33-5351-44cc-b03b-f2cd38fdba25 response_code = 204 uri = /eip-gateways
27312025-01-07T05:18:08.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41796 req_id = 1d7f20e5-ea67-4c0f-89f6-9c07ce6f3ad7 response_code = 204 uri = /vpc-routes
27322025-01-07T05:18:08.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56717
27332025-01-07T05:18:08.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56717 req_id = bdb80704-5849-4596-bbe2-1bea31f77da3 response_code = 200 uri = /v2p
27342025-01-07T05:18:08.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43734
27352025-01-07T05:18:08.858ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27362025-01-07T05:18:08.901ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27372025-01-07T05:18:08.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100610 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43734 req_id = cef9e8da-ee40-4db9-8bc3-bec9a0113b5f response_code = 204 uri = /switch-ports
27382025-01-07T05:18:08.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53265
27392025-01-07T05:18:08.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53265 req_id = b37cf039-9b00-4d79-9161-0f0f55ee029a response_code = 200 uri = /vpc-routes
27402025-01-07T05:18:08.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43734 req_id = e0d56d9f-a94b-4b26-8d96-8a8e4be63588 response_code = 200 uri = /network-bootstore-config
27412025-01-07T05:18:09.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51088
27422025-01-07T05:18:09.001ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27432025-01-07T05:18:09.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27442025-01-07T05:18:09.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27452025-01-07T05:18:09.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27462025-01-07T05:18:09.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27472025-01-07T05:18:09.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27482025-01-07T05:18:09.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27492025-01-07T05:18:09.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51088 req_id = 166c0193-929f-4de4-8384-c809f4dba2cc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27502025-01-07T05:18:09.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47423
27512025-01-07T05:18:09.006ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27522025-01-07T05:18:09.006ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27532025-01-07T05:18:09.006ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:177
27542025-01-07T05:18:09.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37091
27552025-01-07T05:18:09.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27562025-01-07T05:18:09.007ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:177
27572025-01-07T05:18:09.019ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27582025-01-07T05:18:09.019ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5bbe57c7-cdff-41cb-8e81-937c370da161
27592025-01-07T05:18:09.035ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27602025-01-07T05:18:09.035ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:177
27612025-01-07T05:18:09.040ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:177
27622025-01-07T05:18:09.047ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27632025-01-07T05:18:09.047ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5
27642025-01-07T05:18:09.060ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27652025-01-07T05:18:09.060ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5bbe57c7-cdff-41cb-8e81-937c370da161
27662025-01-07T05:18:09.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62792
27672025-01-07T05:18:09.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62792 req_id = 07f32c64-df6d-479a-a186-313559915d51 response_code = 200 uri = /v2p
27682025-01-07T05:18:09.087ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27692025-01-07T05:18:09.087ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5
27702025-01-07T05:18:09.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45624
27712025-01-07T05:18:09.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45624 req_id = 6167f7ae-15cc-4a58-a766-2027f05ca2e1 response_code = 200 uri = /vpc-routes
27722025-01-07T05:18:09.104ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27732025-01-07T05:18:09.104ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ec06319-8348-4c49-b606-b9eed234158a
27742025-01-07T05:18:09.123ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27752025-01-07T05:18:09.123ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ec06319-8348-4c49-b606-b9eed234158a
27762025-01-07T05:18:09.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
27772025-01-07T05:18:09.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 408 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53265 req_id = 51a7d0f4-66ca-4dda-a12e-5a6ab498c2d3 response_code = 204 uri = /eip-gateways
27782025-01-07T05:18:09.142ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27792025-01-07T05:18:09.142ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4
27802025-01-07T05:18:09.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53265 req_id = a9399aa8-59b7-478d-b2b8-217f8befb841 response_code = 204 uri = /vpc-routes
27812025-01-07T05:18:09.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48727
27822025-01-07T05:18:09.154ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
27832025-01-07T05:18:09.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45624 req_id = 220bb348-4fcd-4183-b0d2-0f96f39dc711 response_code = 204 uri = /eip-gateways
27842025-01-07T05:18:09.154ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27852025-01-07T05:18:09.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6027 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45624 req_id = 95d05c75-9ac5-4e46-b54f-d3e75cebe52a response_code = 204 uri = /vpc-routes
27862025-01-07T05:18:09.174ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27872025-01-07T05:18:09.174ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb670df5-eb06-4537-8ba0-b5be2520f226
27882025-01-07T05:18:09.190ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27892025-01-07T05:18:09.191ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4
27902025-01-07T05:18:09.201ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27912025-01-07T05:18:09.209ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27922025-01-07T05:18:09.209ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f
27932025-01-07T05:18:09.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27942025-01-07T05:18:09.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb670df5-eb06-4537-8ba0-b5be2520f226
27952025-01-07T05:18:09.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43873
27962025-01-07T05:18:09.232ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27972025-01-07T05:18:09.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27982025-01-07T05:18:09.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27992025-01-07T05:18:09.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28002025-01-07T05:18:09.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28012025-01-07T05:18:09.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28022025-01-07T05:18:09.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28032025-01-07T05:18:09.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43873 req_id = 4e6638e0-59d8-4948-b3d4-ed2bd7eebc87 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28042025-01-07T05:18:09.250ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28052025-01-07T05:18:09.250ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f
28062025-01-07T05:18:09.261ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28072025-01-07T05:18:09.261ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_feb9b757-126c-48f6-9509-1209dc404e30
28082025-01-07T05:18:09.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48727 req_id = 3b1d4853-03e9-4ffa-af55-3d98b9d83903 response_code = 204 uri = /switch-ports
28092025-01-07T05:18:09.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48727 req_id = 81b45147-a568-44ca-856f-690cd3d38d54 response_code = 200 uri = /network-bootstore-config
28102025-01-07T05:18:09.276ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28112025-01-07T05:18:09.280ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_feb9b757-126c-48f6-9509-1209dc404e30
28122025-01-07T05:18:09.293ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28132025-01-07T05:18:09.294ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2
28142025-01-07T05:18:09.315ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28152025-01-07T05:18:09.315ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c
28162025-01-07T05:18:09.326ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28172025-01-07T05:18:09.326ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2
28182025-01-07T05:18:09.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323662 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47423 req_id = db48795d-8ceb-4224-9172-63381a6b8cf9 response_code = 200 uri = /inventory
28192025-01-07T05:18:09.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50045
28202025-01-07T05:18:09.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28212025-01-07T05:18:09.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28222025-01-07T05:18:09.345ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/config/omicron-zones.json file = common/src/ledger.rs:177
28232025-01-07T05:18:09.345ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/config/omicron-zones.json file = common/src/ledger.rs:177
28242025-01-07T05:18:09.346ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28252025-01-07T05:18:09.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c
28262025-01-07T05:18:09.362ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5bbe57c7-cdff-41cb-8e81-937c370da161 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28272025-01-07T05:18:09.362ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5bbe57c7-cdff-41cb-8e81-937c370da161
28282025-01-07T05:18:09.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53889
28292025-01-07T05:18:09.376ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a24b87a9-ffca-48d7-99b2-082f89fe5eb9, kind: Service { id: 0a80e2dd-4624-43a9-991c-3c9aab3ac405 }, name: Name("external-dns-0a80e2dd-4624-43a9-991c-3c9aab3ac405"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 159])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a491ee23-00d9-41d5-9483-f8c41baa9f9c, kind: Service { id: d6d3a760-2531-491d-aca9-1e6a70cf3495 }, name: Name("external-dns-d6d3a760-2531-491d-aca9-1e6a70cf3495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd893b9-db71-44ba-bede-4d5b326cf8a3, kind: Service { id: 16170e64-6e04-462f-9cc9-85cafa82d6f7 }, name: Name("nexus-16170e64-6e04-462f-9cc9-85cafa82d6f7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 33dc72d5-709c-43fb-ba8a-16bf98b4eb34, kind: Service { id: 217a827c-2873-4be1-b359-addf32248ae5 }, name: Name("nexus-217a827c-2873-4be1-b359-addf32248ae5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55200e40-74e5-47f9-90da-dcd225f585b1, kind: Service { id: 391be182-e0eb-4a5f-9294-ce54683c0a06 }, name: Name("nexus-391be182-e0eb-4a5f-9294-ce54683c0a06"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28302025-01-07T05:18:09.376ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28312025-01-07T05:18:09.376ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28322025-01-07T05:18:09.376ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28332025-01-07T05:18:09.376ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28342025-01-07T05:18:09.376ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28352025-01-07T05:18:09.376ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28362025-01-07T05:18:09.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 450 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53889 req_id = c2a39157-f506-46da-a86e-4910240c696d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28372025-01-07T05:18:09.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 375656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37091 req_id = 27b69e5b-5460-4bfc-85e7-ad1c1e42648b response_code = 200 uri = /inventory
28382025-01-07T05:18:09.388ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6afc368b-2d37-4f7c-ad8d-8a73101045d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28392025-01-07T05:18:09.388ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6afc368b-2d37-4f7c-ad8d-8a73101045d5
28402025-01-07T05:18:09.416ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9ec06319-8348-4c49-b606-b9eed234158a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28412025-01-07T05:18:09.416ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9ec06319-8348-4c49-b606-b9eed234158a
28422025-01-07T05:18:09.440ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fae68f-b3e9-410a-9dce-966279cf1ab4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28432025-01-07T05:18:09.440ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9fae68f-b3e9-410a-9dce-966279cf1ab4
28442025-01-07T05:18:09.464ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb670df5-eb06-4537-8ba0-b5be2520f226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28452025-01-07T05:18:09.464ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb670df5-eb06-4537-8ba0-b5be2520f226
28462025-01-07T05:18:09.491ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b73eeb56-9a68-4f8b-a07c-ffdca950ba0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28472025-01-07T05:18:09.491ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b73eeb56-9a68-4f8b-a07c-ffdca950ba0f
28482025-01-07T05:18:09.519ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: feb9b757-126c-48f6-9509-1209dc404e30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28492025-01-07T05:18:09.519ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_feb9b757-126c-48f6-9509-1209dc404e30
28502025-01-07T05:18:09.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33703
28512025-01-07T05:18:09.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33703 req_id = 8e299195-64fc-4965-b988-226b586ff7cc response_code = 200 uri = /v2p
28522025-01-07T05:18:09.547ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc33774c-0d42-4a7d-aa14-02e0ff49f2d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28532025-01-07T05:18:09.547ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cc33774c-0d42-4a7d-aa14-02e0ff49f2d2
28542025-01-07T05:18:09.573ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a8e2f21d-e6b4-4e6c-ae7c-be1187de116c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28552025-01-07T05:18:09.573ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a8e2f21d-e6b4-4e6c-ae7c-be1187de116c
28562025-01-07T05:18:09.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50045 req_id = bd44c856-20bf-4e90-ac59-d9f91f290662 response_code = 200 uri = /inventory
28572025-01-07T05:18:09.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34880
28582025-01-07T05:18:09.606ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28592025-01-07T05:18:09.646ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28602025-01-07T05:18:09.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34880 req_id = ca6287da-f376-46e8-a160-b5e6e42a90d9 response_code = 204 uri = /switch-ports
28612025-01-07T05:18:09.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34880 req_id = 619b6680-c5d1-4a5d-8753-998238b67142 response_code = 200 uri = /network-bootstore-config
28622025-01-07T05:18:21.309ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7596 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 0d9db341-2304-44e0-8083-12d6ba7445eb response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
28632025-01-07T05:18:28.320ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45583
28642025-01-07T05:18:28.320ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45583 req_id = 4e82bbdc-d6f9-4e2f-af4c-41e4177bbb4c response_code = 200 uri = /baseboard
28652025-01-07T05:18:38.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63726
28662025-01-07T05:18:38.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63726 req_id = 334af40a-df8d-4495-9809-ed26f0d9682a response_code = 200 uri = /v2p
28672025-01-07T05:18:38.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39246
28682025-01-07T05:18:38.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39246 req_id = 33827832-9e8a-450f-a7be-1c908bcb787a response_code = 200 uri = /vpc-routes
28692025-01-07T05:18:38.651ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
28702025-01-07T05:18:38.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39246 req_id = ef31fc30-c70f-4439-b039-129e65a02519 response_code = 204 uri = /eip-gateways
28712025-01-07T05:18:38.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39246 req_id = 44b6d098-f4ec-4961-91cf-fda1efee22a2 response_code = 204 uri = /vpc-routes
28722025-01-07T05:18:38.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39526
28732025-01-07T05:18:38.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28742025-01-07T05:18:38.756ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28752025-01-07T05:18:38.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39526 req_id = 30090828-a362-48f9-93ec-667e1d50a354 response_code = 204 uri = /switch-ports
28762025-01-07T05:18:38.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52413
28772025-01-07T05:18:38.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52413 req_id = 38d2715e-c9e6-4f71-982b-a7c1ad49ca6c response_code = 200 uri = /v2p
28782025-01-07T05:18:38.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39526 req_id = 5b400008-c3ca-4941-8613-03fdf7b62b2d response_code = 200 uri = /network-bootstore-config
28792025-01-07T05:18:38.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51061
28802025-01-07T05:18:38.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51061 req_id = 62bd39c3-3634-4d83-9e3a-0bc451b3a03d response_code = 200 uri = /vpc-routes
28812025-01-07T05:18:38.854ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
28822025-01-07T05:18:38.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51061 req_id = 002624d2-dd71-4656-a552-87233e78cb06 response_code = 204 uri = /eip-gateways
28832025-01-07T05:18:38.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51061 req_id = abc5b887-979f-4681-9289-581a99223577 response_code = 204 uri = /vpc-routes
28842025-01-07T05:18:38.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65287
28852025-01-07T05:18:38.901ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28862025-01-07T05:18:38.942ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28872025-01-07T05:18:39.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101168 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65287 req_id = a369d537-3bd2-4016-8de0-b9d5711d8fac response_code = 204 uri = /switch-ports
28882025-01-07T05:18:39.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44491
28892025-01-07T05:18:39.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47087
28902025-01-07T05:18:39.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65287 req_id = c53f8d39-5d60-4ff3-8785-d6b39e921ca9 response_code = 200 uri = /network-bootstore-config
28912025-01-07T05:18:39.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44491 req_id = be5b7ad1-a49f-47d4-8a16-d0a13e2698b7 response_code = 200 uri = /v2p
28922025-01-07T05:18:39.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47087 req_id = b9ed3dc6-87ea-4e7a-978e-e6ee9cc7d649 response_code = 200 uri = /vpc-routes
28932025-01-07T05:18:39.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
28942025-01-07T05:18:39.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47087 req_id = 3593d592-0769-4757-83a1-63ab604e81af response_code = 204 uri = /eip-gateways
28952025-01-07T05:18:39.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47087 req_id = 88636076-8f1e-417a-a04d-4ba485bd1ad9 response_code = 204 uri = /vpc-routes
28962025-01-07T05:18:39.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39600
28972025-01-07T05:18:39.080ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28982025-01-07T05:18:39.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28992025-01-07T05:18:39.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39600 req_id = 7ebf471f-6132-450b-b902-1abed410c4cd response_code = 204 uri = /switch-ports
29002025-01-07T05:18:39.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39600 req_id = 43f3cc05-99fa-4ef3-b6e8-cfe66ae40f40 response_code = 200 uri = /network-bootstore-config
29012025-01-07T05:18:51.308ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7021 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = b6eb150a-c85f-41bc-9ab3-2a3546c0f0af response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
29022025-01-07T05:18:58.353ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38880
29032025-01-07T05:18:58.353ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38880 req_id = a5f06043-cc05-4faa-84fd-1b5875433826 response_code = 200 uri = /baseboard
29042025-01-07T05:19:08.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60127
29052025-01-07T05:19:08.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60127 req_id = af59aa42-0159-4ef2-a396-6d5eafd9836e response_code = 200 uri = /vpc-routes
29062025-01-07T05:19:08.652ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
29072025-01-07T05:19:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60127 req_id = 74712cc1-4b41-4eb6-ac0a-9cecb959bd8a response_code = 204 uri = /eip-gateways
29082025-01-07T05:19:08.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60127 req_id = 66c1427a-f175-417c-b906-6b7c0c26cedb response_code = 204 uri = /vpc-routes
29092025-01-07T05:19:08.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53154
29102025-01-07T05:19:08.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53154 req_id = c1af650f-f13c-4257-ae75-11f4c1755ef2 response_code = 200 uri = /v2p
29112025-01-07T05:19:08.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48447
29122025-01-07T05:19:08.778ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29132025-01-07T05:19:08.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29142025-01-07T05:19:08.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48447 req_id = 4b14e7fa-5ab2-43b2-b02e-06da778928f7 response_code = 204 uri = /switch-ports
29152025-01-07T05:19:08.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41756
29162025-01-07T05:19:08.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41756 req_id = b26177d7-0fe0-4eaf-903d-3d507475436f response_code = 200 uri = /vpc-routes
29172025-01-07T05:19:08.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48447 req_id = 7ca7ad07-a66b-490d-9d74-159b5bc247b6 response_code = 200 uri = /network-bootstore-config
29182025-01-07T05:19:08.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65472
29192025-01-07T05:19:08.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65472 req_id = fde8332f-0a41-4e4c-bcb7-f16adc451564 response_code = 200 uri = /v2p
29202025-01-07T05:19:09.011ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
29212025-01-07T05:19:09.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41756 req_id = aa62d045-1a76-445e-9270-7a07b04f9b20 response_code = 204 uri = /eip-gateways
29222025-01-07T05:19:09.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41756 req_id = a0e6c390-16d8-402d-a968-82f71b735f96 response_code = 204 uri = /vpc-routes
29232025-01-07T05:19:09.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52370
29242025-01-07T05:19:09.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52370 req_id = 1034cf21-70cc-4a15-8e1c-9f11537d0579 response_code = 200 uri = /vpc-routes
29252025-01-07T05:19:09.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58576
29262025-01-07T05:19:09.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58576 req_id = 2b1cb304-686c-43a4-ab86-315f296f5a2b response_code = 200 uri = /v2p
29272025-01-07T05:19:09.104ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
29282025-01-07T05:19:09.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52370 req_id = 54cec49c-6158-4a2e-8907-f4557e0802d0 response_code = 204 uri = /eip-gateways
29292025-01-07T05:19:09.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52370 req_id = a8e44483-b963-4d3f-9fd8-85dd49b2b0f1 response_code = 204 uri = /vpc-routes
29302025-01-07T05:19:09.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42788
29312025-01-07T05:19:09.209ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29322025-01-07T05:19:09.247ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29332025-01-07T05:19:09.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42788 req_id = ae24fe31-29ee-4790-acd1-755a97ae97cd response_code = 204 uri = /switch-ports
29342025-01-07T05:19:09.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48388
29352025-01-07T05:19:09.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29362025-01-07T05:19:09.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42788 req_id = 3dd1b21d-4c7a-4a12-97d7-42152de43e06 response_code = 200 uri = /network-bootstore-config
29372025-01-07T05:19:09.341ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29382025-01-07T05:19:09.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92485 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48388 req_id = 38f8240e-927d-44fb-80a2-2bc500975276 response_code = 204 uri = /switch-ports
29392025-01-07T05:19:09.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48388 req_id = 4b181c77-22cd-4ac3-8d81-7f8e480ce4cd response_code = 200 uri = /network-bootstore-config
29402025-01-07T05:19:21.308ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7575 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = 814ea654-e013-4641-83ba-347a1e786308 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546
29412025-01-07T05:19:27.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33046
29422025-01-07T05:19:27.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33046 req_id = a190233d-299f-4e2e-88b1-c0f37a85f8bf response_code = 200 uri = /v2p
29432025-01-07T05:19:27.764ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9537238) }
29442025-01-07T05:19:27.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3600 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33046 req_id = eab00e54-4ae0-4855-9228-1cd8f41cd9c0 response_code = 204 uri = /v2p
29452025-01-07T05:19:27.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58800
29462025-01-07T05:19:27.868ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a40e665b-fc75-42cc-9203-d9a5ed9a0874, kind: Instance { id: c7eb3214-b57e-411b-a7f0-77dfa4fb283d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9537238), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a40e665b-fc75-42cc-9203-d9a5ed9a0874, kind: Instance { id: c7eb3214-b57e-411b-a7f0-77dfa4fb283d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9537238), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a40e665b-fc75-42cc-9203-d9a5ed9a0874, kind: Instance { id: c7eb3214-b57e-411b-a7f0-77dfa4fb283d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9537238), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9537238))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a40e665b-fc75-42cc-9203-d9a5ed9a0874, kind: Instance { id: c7eb3214-b57e-411b-a7f0-77dfa4fb283d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9537238), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 5675103c-6e8c-4788-bbf1-72b35cb2a95e, slot: 0, read_only: false, vcr_json: .., name: "disk-5a1e35174f" }], boot_settings: Some(InstanceBootSettings { order: [5675103c-6e8c-4788-bbf1-72b35cb2a95e] }), cloud_init_bytes: Some(..) } instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d metadata = InstanceMetadata { silo_id: 0681d1fd-d397-4a2a-ba57-de7b9ff17946, project_id: bb328665-af86-4c12-9d88-147f5cf08bb6 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-07T05:19:27.866077224Z }
29472025-01-07T05:19:27.868ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d migration_id = None propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29482025-01-07T05:19:27.869ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d migration_id = None propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a40e665b-fc75-42cc-9203-d9a5ed9a0874, kind: Instance { id: c7eb3214-b57e-411b-a7f0-77dfa4fb283d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9537238), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a40e665b-fc75-42cc-9203-d9a5ed9a0874, kind: Instance { id: c7eb3214-b57e-411b-a7f0-77dfa4fb283d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9537238), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a40e665b-fc75-42cc-9203-d9a5ed9a0874, kind: Instance { id: c7eb3214-b57e-411b-a7f0-77dfa4fb283d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9537238), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9537238))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a40e665b-fc75-42cc-9203-d9a5ed9a0874, kind: Instance { id: c7eb3214-b57e-411b-a7f0-77dfa4fb283d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9537238), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 5675103c-6e8c-4788-bbf1-72b35cb2a95e, slot: 0, read_only: false, vcr_json: .., name: "disk-5a1e35174f" }], boot_settings: Some(InstanceBootSettings { order: [5675103c-6e8c-4788-bbf1-72b35cb2a95e] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-07T05:19:27.866077224Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29492025-01-07T05:19:27.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6001 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58800 req_id = 2467089e-5161-4fd7-8054-40c701d972b9 response_code = 200 uri = /vmms/6719107a-aea7-480d-8b48-19e67988c62f
29502025-01-07T05:19:27.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63521
29512025-01-07T05:19:27.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1518 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63521 req_id = 68dcc594-3d7a-4875-aa83-8f8a9e704345 response_code = 200 uri = /vmms/6719107a-aea7-480d-8b48-19e67988c62f/state
29522025-01-07T05:19:27.990ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 9537238 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29532025-01-07T05:19:27.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29542025-01-07T05:19:28.030ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f file = illumos-utils/src/zone.rs:325 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29552025-01-07T05:19:28.053ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f file = illumos-utils/src/zone.rs:363 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29562025-01-07T05:19:28.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38464
29572025-01-07T05:19:28.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38464 req_id = 4de2bed7-16be-4b5f-af13-b7400845d498 response_code = 200 uri = /vpc-routes
29582025-01-07T05:19:28.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {a40e665b-fc75-42cc-9203-d9a5ed9a0874: {10.151.2.175: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}, 10.151.2.176: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}}} }
29592025-01-07T05:19:28.392ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57100
29602025-01-07T05:19:28.392ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57100 req_id = ef955957-9ba2-4ac7-be58-e4320ae76857 response_code = 200 uri = /baseboard
29612025-01-07T05:19:29.474ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29622025-01-07T05:19:29.474ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f zone file = illumos-utils/src/running_zone.rs:488 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29632025-01-07T05:19:29.684ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 55.983144ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29642025-01-07T05:19:29.755ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 114.258214ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29652025-01-07T05:19:29.897ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 229.348183ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29662025-01-07T05:19:30.135ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 200.82785ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29672025-01-07T05:19:30.351ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 541.431758ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29682025-01-07T05:19:30.908ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 810.967711ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29692025-01-07T05:19:31.730ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 743.654521ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29702025-01-07T05:19:32.485ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 722.917307ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29712025-01-07T05:19:33.217ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 1.069139188s file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29722025-01-07T05:19:34.297ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 595.561532ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f zone = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
29732025-01-07T05:19:34.922ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f file = sled-agent/src/instance.rs:2067 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29742025-01-07T05:19:34.930ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 58.423085ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29752025-01-07T05:19:34.999ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f") failed: Property not found. retry in 128.840844ms file = illumos-utils/src/svc.rs:36 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29762025-01-07T05:19:35.138ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29772025-01-07T05:19:35.176ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29782025-01-07T05:19:35.316ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29792025-01-07T05:19:35.317ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
29802025-01-07T05:19:35.317ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-07T05:19:35.317855498Z } file = sled-agent/src/instance.rs:780 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29812025-01-07T05:19:35.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7205223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38464 req_id = ddaa827f-0346-4ac8-9157-ece82a1df880 response_code = 204 uri = /eip-gateways
29822025-01-07T05:19:35.317ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-07T05:19:35.317855498Z } propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29832025-01-07T05:19:35.318ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-07T05:19:35.317855498Z }, migration_in: None, migration_out: None }
29842025-01-07T05:19:35.343ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-07T05:19:35.343381353Z } file = sled-agent/src/instance.rs:780 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29852025-01-07T05:19:35.343ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-07T05:19:35.343381353Z } propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
29862025-01-07T05:19:35.343ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-07T05:19:35.343381353Z }, migration_in: None, migration_out: None }
29872025-01-07T05:19:35.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 557 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38464 req_id = 43a268de-5a49-4f05-a68f-895d7a51b710 response_code = 204 uri = /vpc-routes
29882025-01-07T05:19:38.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51139
29892025-01-07T05:19:38.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51139 req_id = 2587d522-c7a0-4a1e-8778-d61130240746 response_code = 200 uri = /vmms/6719107a-aea7-480d-8b48-19e67988c62f/state
29902025-01-07T05:19:38.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41173
29912025-01-07T05:19:38.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41173 req_id = 08542631-6696-47a8-b360-7d2297fd899f response_code = 200 uri = /vpc-routes
29922025-01-07T05:19:38.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47024
29932025-01-07T05:19:38.707ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29942025-01-07T05:19:38.771ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29952025-01-07T05:19:38.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47024 req_id = c24573e7-e9ce-4d05-b85d-1b07a7b9a7a0 response_code = 204 uri = /switch-ports
29962025-01-07T05:19:38.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57586
29972025-01-07T05:19:38.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48825
29982025-01-07T05:19:38.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33256
29992025-01-07T05:19:38.852ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {a40e665b-fc75-42cc-9203-d9a5ed9a0874: {10.151.2.176: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}, 10.151.2.175: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}}} }
30002025-01-07T05:19:38.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41173 req_id = 163f1871-1a1f-4713-917f-5b8945f2d080 response_code = 204 uri = /eip-gateways
30012025-01-07T05:19:38.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57586 req_id = 2b040283-4c98-43db-bb03-f87aaeb5d092 response_code = 200 uri = /vpc-routes
30022025-01-07T05:19:38.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 429 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47024 req_id = 0f10e62e-b33a-43ba-9191-94f808b25d27 response_code = 200 uri = /network-bootstore-config
30032025-01-07T05:19:38.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33256 req_id = 763120e2-c45b-42ed-8801-133da75cc9d3 response_code = 200 uri = /vmms/6719107a-aea7-480d-8b48-19e67988c62f/state
30042025-01-07T05:19:38.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48825 req_id = ae14480f-8dbf-469b-ae7f-8ba3bbb81ab7 response_code = 200 uri = /v2p
30052025-01-07T05:19:38.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45051
30062025-01-07T05:19:38.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45051 req_id = 39799b41-935e-487d-99b9-39a2eac81f02 response_code = 200 uri = /v2p
30072025-01-07T05:19:38.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49742
30082025-01-07T05:19:38.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49742 req_id = ff6dc795-3232-47cf-84ea-3d3455618226 response_code = 200 uri = /vmms/6719107a-aea7-480d-8b48-19e67988c62f/state
30092025-01-07T05:19:38.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41173 req_id = 340921de-9bb1-491c-8365-401d636d3ea9 response_code = 204 uri = /vpc-routes
30102025-01-07T05:19:38.913ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {a40e665b-fc75-42cc-9203-d9a5ed9a0874: {10.151.2.176: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}, 10.151.2.175: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}}} }
30112025-01-07T05:19:38.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57586 req_id = ee95893d-a94d-4bbd-820c-7c0764c25ecf response_code = 204 uri = /eip-gateways
30122025-01-07T05:19:38.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51769
30132025-01-07T05:19:38.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
30142025-01-07T05:19:38.965ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
30152025-01-07T05:19:39.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126864 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51769 req_id = 12d2718d-72b3-4a4a-b6c7-db412d845a02 response_code = 204 uri = /switch-ports
30162025-01-07T05:19:39.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49778
30172025-01-07T05:19:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51769 req_id = 00106435-d658-4b11-9913-95e679a9c0c6 response_code = 200 uri = /network-bootstore-config
30182025-01-07T05:19:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49778 req_id = 635e2185-1356-40ff-ba69-1186c0320768 response_code = 200 uri = /vpc-routes
30192025-01-07T05:19:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57586 req_id = 1b61b2cf-cbca-4dd1-8c7d-3cf71bb177c5 response_code = 204 uri = /vpc-routes
30202025-01-07T05:19:39.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {a40e665b-fc75-42cc-9203-d9a5ed9a0874: {10.151.2.176: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}, 10.151.2.175: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}}} }
30212025-01-07T05:19:39.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49778 req_id = f2c49039-d157-4934-84c7-1adec9ed6940 response_code = 204 uri = /eip-gateways
30222025-01-07T05:19:39.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51082
30232025-01-07T05:19:39.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
30242025-01-07T05:19:39.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
30252025-01-07T05:19:39.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51082 req_id = 54f4373a-b556-4c4a-8588-1b6a23818786 response_code = 204 uri = /switch-ports
30262025-01-07T05:19:39.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51657
30272025-01-07T05:19:39.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51657 req_id = db7dcbaa-bf21-4ed9-96f9-1dd722c005f6 response_code = 200 uri = /v2p
30282025-01-07T05:19:39.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51082 req_id = ad50ea70-95e2-4c2c-85b8-a1868bdecb72 response_code = 200 uri = /network-bootstore-config
30292025-01-07T05:19:39.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49778 req_id = b93ae287-57d6-4754-9d2e-54a8085d03db response_code = 204 uri = /vpc-routes
30302025-01-07T05:19:45.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47795
30312025-01-07T05:19:45.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 557 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47795 req_id = 98bd2c02-daea-4f63-8ad4-b7e3e17110db response_code = 200 uri = /vmms/6719107a-aea7-480d-8b48-19e67988c62f/state
30322025-01-07T05:19:45.608ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-07T05:19:45.608899448Z } file = sled-agent/src/instance.rs:780 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
30332025-01-07T05:19:45.608ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-07T05:19:45.608899448Z } propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
30342025-01-07T05:19:45.608ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-07T05:19:45.608899448Z }, migration_in: None, migration_out: None }
30352025-01-07T05:19:45.650ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-07T05:19:45.650387804Z } file = sled-agent/src/instance.rs:780 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
30362025-01-07T05:19:45.650ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-07T05:19:45.650387804Z } propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
30372025-01-07T05:19:45.650ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
30382025-01-07T05:19:45.650ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30392025-01-07T05:19:45.650ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 9637379969823588876 n_samples = 6 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
30402025-01-07T05:19:45.650ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30412025-01-07T05:19:45.650ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/0903eba0-a42b-4f15-a659-5669cab98e49/debug/bundle/zone", "/pool/int/3e7f7b98-d0f6-4a42-a3ce-fe5fd08e70f0/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/5bbe57c7-cdff-41cb-8e81-937c370da161/crypt/debug", "/pool/ext/6afc368b-2d37-4f7c-ad8d-8a73101045d5/crypt/debug", "/pool/ext/9ec06319-8348-4c49-b606-b9eed234158a/crypt/debug", "/pool/ext/f9fae68f-b3e9-410a-9dce-966279cf1ab4/crypt/debug", "/pool/ext/fb670df5-eb06-4537-8ba0-b5be2520f226/crypt/debug", "/pool/ext/b73eeb56-9a68-4f8b-a07c-ffdca950ba0f/crypt/debug", "/pool/ext/feb9b757-126c-48f6-9509-1209dc404e30/crypt/debug", "/pool/ext/cc33774c-0d42-4a7d-aa14-02e0ff49f2d2/crypt/debug", "/pool/ext/a8e2f21d-e6b4-4e6c-ae7c-be1187de116c/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f
30422025-01-07T05:19:45.650ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 17509702164869702859 n_samples = 6 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
30432025-01-07T05:19:46.294ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f", bundle_id: cfd12b58-4a0b-4a59-bca6-a4d90ceabbe4 }, time_created: 2025-01-07T05:19:45.651958972Z, version: 0, cause: TerminatedInstance }
30442025-01-07T05:19:46.294ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_6719107a-aea7-480d-8b48-19e67988c62f file = sled-agent/src/instance.rs:1313 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
30452025-01-07T05:19:48.057ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
30462025-01-07T05:19:48.074ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(9537238), kind: System }
30472025-01-07T05:19:48.074ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(9537238), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30482025-01-07T05:19:48.074ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-07T05:19:48.074433168Z }, migration_in: None, migration_out: None }
30492025-01-07T05:19:48.101ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-07T05:19:48.074433168Z }, migration_in: None, migration_out: None }
30502025-01-07T05:19:48.105ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = c7eb3214-b57e-411b-a7f0-77dfa4fb283d propolis_id = 6719107a-aea7-480d-8b48-19e67988c62f
30512025-01-07T05:19:48.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59764
30522025-01-07T05:19:48.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59764 req_id = e6af1420-625b-4018-8a0e-7ceb7eead801 response_code = 200 uri = /vpc-routes
30532025-01-07T05:19:48.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {a40e665b-fc75-42cc-9203-d9a5ed9a0874: {10.151.2.176: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}, 10.151.2.175: {bf654eb3-b44f-4a57-b26b-bdc2b266ddd9}}} }
30542025-01-07T05:19:48.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59764 req_id = 10dee403-1f49-4091-83a3-7bdb2999b2d0 response_code = 204 uri = /eip-gateways
30552025-01-07T05:19:48.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59764 req_id = b0f3c779-193d-4ecc-9846-b402bf1adc81 response_code = 204 uri = /vpc-routes
30562025-01-07T05:19:48.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32887
30572025-01-07T05:19:48.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32887 req_id = 83283e3d-c406-4444-95db-1ab65d337c5c response_code = 200 uri = /v2p
30582025-01-07T05:19:48.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55366
30592025-01-07T05:19:48.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55366 req_id = 877a7df3-0a39-4022-a4ca-fbb7a133fa6f response_code = 200 uri = /v2p
30602025-01-07T05:19:49.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61826
30612025-01-07T05:19:49.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61826 req_id = 78e45072-fa0e-4eb6-99f5-02a7692111bd response_code = 200 uri = /vpc-routes
30622025-01-07T05:19:49.121ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
30632025-01-07T05:19:49.121ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546
30642025-01-07T05:19:49.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61826 req_id = 05625b3b-4424-4b82-b7af-e6d67ef9b75f response_code = 204 uri = /eip-gateways
30652025-01-07T05:19:49.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61826 req_id = ceac810b-dae6-4f81-b5ae-b69d65657a0d response_code = 204 uri = /vpc-routes
30662025-01-07T05:19:49.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56747
30672025-01-07T05:19:49.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56747 req_id = ef2d1e05-818f-4e73-a141-bb72141f9f4e response_code = 200 uri = /vpc-routes
30682025-01-07T05:19:49.767ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 values = ExternalIpGatewayMap { mappings: {} }
30692025-01-07T05:19:49.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56747 req_id = 27720124-9c3f-4abb-9074-730ff4400a31 response_code = 204 uri = /eip-gateways
30702025-01-07T05:19:49.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56747 req_id = 5e246322-8d96-4065-8157-9caeb3a2d00c response_code = 204 uri = /vpc-routes
30712025-01-07T05:19:51.308ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7179 local_addr = [fd00:1122:3344:101::1]:46453 method = GET remote_addr = [fd00:1122:3344:101::d]:56037 req_id = ffa2b728-42ee-4b2d-bc2a-b9166267b7f4 response_code = 200 sled_id = ed42aaef-618c-4920-bad3-c2a5ed2fd546 uri = /ed42aaef-618c-4920-bad3-c2a5ed2fd546