Max level shown:
1 [ Dec 21 08:12:28 Enabled. ]
2 [ Dec 21 08:12:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 08:12:28 Method "start" exited with status 0. ]
4 [ Dec 21 08:12:28 Rereading configuration. ]
5 [ Dec 21 08:12:28 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T08:12:28.679ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T08:12:28.679ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T08:12:28.731ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T08:12:28.731ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T08:12:28.846ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T08:12:28.855ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T08:12:28.863ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T08:12:29.464ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-21T08:12:29.600ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T08:12:29.600ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T08:12:29.601ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T08:12:29.601ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-21T08:12:29.601ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-21T08:12:29.601ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-21T08:12:29.604ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T08:12:29.604ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T08:12:29.604ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T08:12:29.604ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T08:12:29.604ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T08:12:29.604ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T08:12:29.604ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T08:12:29.604ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T08:12:29.604ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T08:12:29.616ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T08:12:29.616ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool)
322024-12-21T08:12:29.717ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal }
332024-12-21T08:12:30.088ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T08:12:30.088ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T08:12:30.088ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T08:12:30.088ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T08:12:30.088ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-21T08:12:30.088ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-21T08:12:30.088ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-21T08:12:30.097ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-21T08:12:30.097ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool)
422024-12-21T08:12:30.186ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal }
432024-12-21T08:12:30.549ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-21T08:12:30.549ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-21T08:12:30.549ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-12-21T08:12:30.549ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-21T08:12:30.549ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-21T08:12:30.549ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-21T08:12:30.549ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542024-12-21T08:12:30.549ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-21T08:12:30.549ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-21T08:12:30.549ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-12-21T08:12:30.549ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602024-12-21T08:12:30.549ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-21T08:12:30.549ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-21T08:12:30.549ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632024-12-21T08:12:30.549ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-12-21T08:12:30.549ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-21T08:12:30.549ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-21T08:12:30.549ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-21T08:12:30.549ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722024-12-21T08:12:30.549ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-21T08:12:30.549ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-21T08:12:30.549ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-21T08:12:30.549ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-21T08:12:30.550ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-21T08:12:30.550ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-21T08:12:30.550ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-21T08:12:30.550ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-21T08:12:30.550ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-12-21T08:12:30.550ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
832024-12-21T08:12:30.550ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-12-21T08:12:30.550ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-21T08:12:30.550ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-21T08:12:30.550ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-12-21T08:12:30.550ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-12-21T08:12:30.550ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-12-21T08:12:30.550ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902024-12-21T08:12:30.550ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-12-21T08:12:30.550ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-21T08:12:30.550ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-12-21T08:12:30.550ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-12-21T08:12:30.550ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952024-12-21T08:12:30.550ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962024-12-21T08:12:30.550ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-12-21T08:12:30.550ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-21T08:12:30.550ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992024-12-21T08:12:30.550ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1002024-12-21T08:12:30.550ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1012024-12-21T08:12:30.550ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022024-12-21T08:12:30.550ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032024-12-21T08:12:30.550ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-21T08:12:30.550ZINFOSledAgent (bootstore): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-21T08:12:30.550ZINFOSledAgent (bootstore): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-21T08:12:30.550ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-21T08:12:30.550ZINFOSledAgent (bootstore): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-21T08:12:30.550ZINFOSledAgent (bootstore): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-21T08:12:30.550ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-21T08:12:30.550ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-21T08:12:30.550ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-21T08:12:30.561ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-21T08:12:30.561ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1382, tv_nsec: 267673839 } time_to_next_cleanup = 599.999913759s
1142024-12-21T08:12:30.561ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1152024-12-21T08:12:30.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162024-12-21T08:12:30.561ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-21T08:12:30.564ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-21T08:12:30.565ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-21T08:12:30.566ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-21T08:12:30.567ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-21T08:12:30.567ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-21T08:12:30.567ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-21T08:12:30.567ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-21T08:12:30.567ZINFOSledAgent (RSS): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-21T08:12:30.567ZINFOSledAgent (RSS): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-21T08:12:30.567ZINFOSledAgent (RSS): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-21T08:12:30.567ZINFOSledAgent (RSS): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-21T08:12:30.567ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-21T08:12:30.567ZINFOSledAgent (RSS): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-21T08:12:30.567ZINFOSledAgent (RSS): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-21T08:12:30.567ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-21T08:12:30.567ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-21T08:12:30.567ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-21T08:12:30.567ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-21T08:12:30.567ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-21T08:12:30.568ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-21T08:12:30.568ZINFOSledAgent (bootstore): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-21T08:12:30.568ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-21T08:12:30.568ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 118e564e-0bce-46c7-b69d-5b3dee81ed48 (sled), rack_id: 0b343a9a-3fe3-40dd-a473-997a9020bae4, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-21T08:12:30.568ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1412024-12-21T08:12:30.568ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1422024-12-21T08:12:30.573ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-21T08:12:30.578ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-21T08:12:30.578ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-21T08:12:30.583ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-21T08:12:30.583ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-21T08:12:30.583ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:42213
1482024-12-21T08:12:30.583ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 118e564e-0bce-46c7-b69d-5b3dee81ed48 (sled), rack_id: 0b343a9a-3fe3-40dd-a473-997a9020bae4, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-21T08:12:30.583ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-21T08:12:30.583ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-21T08:12:30.583ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1522024-12-21T08:12:30.583ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1532024-12-21T08:12:30.583ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542024-12-21T08:12:30.583ZINFOSledAgent (StorageManager): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-21T08:12:30.583ZINFOSledAgent (StorageManager): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-21T08:12:30.583ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1572024-12-21T08:12:30.583ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1582024-12-21T08:12:30.583ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-21T08:12:30.583ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-21T08:12:30.583ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-21T08:12:30.583ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-21T08:12:30.600ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-21T08:12:30.620ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-21T08:12:30.638ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-21T08:12:30.647ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
1662024-12-21T08:12:30.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-21T08:12:30.647ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
1682024-12-21T08:12:30.647ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-21T08:12:30.650ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 50.07878ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f3f2da4f-687d-4bcf-955f-2ebb25af39ed", "content-length": "124", "date": "Sat, 21 Dec 2024 08:12:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f3f2da4f-687d-4bcf-955f-2ebb25af39ed" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-21T08:12:30.660ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_a705724f-fca8-4ba5-9e4a-4ba744362879/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-21T08:12:30.683ZINFOSledAgent: successfully created encrypted zvol: name="oxi_a705724f-fca8-4ba5-9e4a-4ba744362879/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-21T08:12:30.683ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_a705724f-fca8-4ba5-9e4a-4ba744362879/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-21T08:12:30.688ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
1742024-12-21T08:12:30.688ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-21T08:12:30.688ZINFOSledAgent (BackingFs): Ensuring dataset oxi_a705724f-fca8-4ba5-9e4a-4ba744362879/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-21T08:12:30.701ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-21T08:12:30.701ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 72.626235ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "02acd9fe-20a0-4124-a958-e53d13a1868c", "content-length": "124", "date": "Sat, 21 Dec 2024 08:12:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "02acd9fe-20a0-4124-a958-e53d13a1868c" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-21T08:12:30.756ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792024-12-21T08:12:30.774ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-21T08:12:30.775ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 162.647447ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6b99342f-3ca0-45bc-bccb-d939b57514de", "content-length": "124", "date": "Sat, 21 Dec 2024 08:12:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6b99342f-3ca0-45bc-bccb-d939b57514de" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-21T08:12:30.939ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-12-21T08:12:30.940ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 141.430473ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f8157c7e-0c92-43e9-9230-b4b7ea850282", "content-length": "124", "date": "Sat, 21 Dec 2024 08:12:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f8157c7e-0c92-43e9-9230-b4b7ea850282" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-12-21T08:12:30.975ZINFOSledAgent (BackingFs): Mounting oxi_a705724f-fca8-4ba5-9e4a-4ba744362879/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842024-12-21T08:12:30.989ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852024-12-21T08:12:30.989ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862024-12-21T08:12:30.989ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872024-12-21T08:12:30.989ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882024-12-21T08:12:31.082ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-21T08:12:31.082ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 238.344287ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "623cb1ff-ec7c-487e-bb67-9ce034a1699b", "content-length": "124", "date": "Sat, 21 Dec 2024 08:12:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "623cb1ff-ec7c-487e-bb67-9ce034a1699b" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-21T08:12:31.322ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-21T08:12:31.323ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 287.455955ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4ad59fe2-4cb0-4b28-8e0e-a69912190503", "content-length": "124", "date": "Sat, 21 Dec 2024 08:12:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4ad59fe2-4cb0-4b28-8e0e-a69912190503" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-21T08:12:31.611ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-21T08:12:31.612ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 265.291139ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0758e22a-42c5-4401-b245-70690677facd", "content-length": "124", "date": "Sat, 21 Dec 2024 08:12:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0758e22a-42c5-4401-b245-70690677facd" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-21T08:12:31.719ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
1952024-12-21T08:12:31.724ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:62812 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
1962024-12-21T08:12:31.725ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
1972024-12-21T08:12:31.725ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:62812 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
1982024-12-21T08:12:31.726ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 157.534126ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
1992024-12-21T08:12:31.727ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2002024-12-21T08:12:31.727ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2012024-12-21T08:12:31.727ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022024-12-21T08:12:31.727ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-12-21T08:12:31.878ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-12-21T08:12:31.885ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 650.337986ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2052024-12-21T08:12:32.537ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.01724042s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2062024-12-21T08:12:33.556ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.25055547s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2072024-12-21T08:12:34.416ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2082024-12-21T08:12:34.416ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2092024-12-21T08:12:34.416ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2102024-12-21T08:12:34.416ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2112024-12-21T08:12:34.416ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2122024-12-21T08:12:34.416ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2132024-12-21T08:12:34.418ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2142024-12-21T08:12:34.419ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2152024-12-21T08:12:34.419ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='9c3b14c5-b24d-44cd-8948-19e400d55b9f'/> <propval type="astring" name="rack_id" value='0b343a9a-3fe3-40dd-a473-997a9020bae4'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feca:243d'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='0b343a9a-3fe3-40dd-a473-997a9020bae4'/> <propval type="astring" name="sled_id" value='118e564e-0bce-46c7-b69d-5b3dee81ed48'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='118e564e-0bce-46c7-b69d-5b3dee81ed48'/> <propval type="astring" name="rack_uuid" value='0b343a9a-3fe3-40dd-a473-997a9020bae4'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='118e564e-0bce-46c7-b69d-5b3dee81ed48'/> <propval type="astring" name="rack_uuid" value='0b343a9a-3fe3-40dd-a473-997a9020bae4'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-12-21T08:12:34.420ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-12-21T08:12:34.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 73.827844ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-21T08:12:34.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 85.49159ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-21T08:12:35.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 248.534284ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-21T08:12:35.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 420.556988ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-21T08:12:35.808ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.239306775s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2222024-12-21T08:12:36.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 896.256597ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-21T08:12:37.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 616.893826ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-21T08:12:37.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.090411639s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-21T08:12:38.050ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.219272743s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2262024-12-21T08:12:38.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.388114479s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-12-21T08:12:40.699ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/nexus.rs:527 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2282024-12-21T08:12:40.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292024-12-21T08:12:40.730ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2302024-12-21T08:12:40.731ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-12-21T08:12:40.731ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-12-21T08:12:40.731ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332024-12-21T08:12:40.731ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-21T08:12:40.731ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-12-21T08:12:40.731ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-12-21T08:12:40.731ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-12-21T08:12:40.731ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2382024-12-21T08:12:40.948ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:42213
2392024-12-21T08:12:40.948ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2402024-12-21T08:12:40.948ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2412024-12-21T08:12:40.960ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422024-12-21T08:12:40.960ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2432024-12-21T08:12:40.960ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442024-12-21T08:12:41.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41799
2452024-12-21T08:12:41.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462024-12-21T08:12:41.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472024-12-21T08:12:41.233ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-21T08:12:41.233ZINFOSledAgent (ServiceManager): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:188
2492024-12-21T08:12:41.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41799 req_id = 62987135-5943-457c-9479-7c873de4736b response_code = 200 uri = /inventory
2502024-12-21T08:12:41.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63233
2512024-12-21T08:12:41.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63233 req_id = f01051d4-6c01-49be-8612-3123df5b3cba response_code = 200 uri = /sled-role
2522024-12-21T08:12:41.297ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8aad4b87-ae1f-4f2b-9e2f-c8d82724567e (physical_disk), pool_id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8b45a2fa-928a-4db8-ae2d-410fe5f8c05f (physical_disk), pool_id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 1559ea89-2e98-43d9-be77-7e71cc42a93e (physical_disk), pool_id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 5f04ff51-1a50-4756-93bd-21ba40559315 (physical_disk), pool_id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f0d0eaae-bc11-4cd4-ae5c-ca8402b2f735 (physical_disk), pool_id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a4c0733f-8ad1-43c2-849a-5602ee8075c1 (physical_disk), pool_id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 0bc5b9e9-2e1f-4491-852a-7cb926fc8195 (physical_disk), pool_id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 4e30063c-250f-425a-be1d-a27ee4e36ff6 (physical_disk), pool_id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: f5e32927-adc0-439a-8a2e-2c36958c80c5 (physical_disk), pool_id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532024-12-21T08:12:41.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51204
2542024-12-21T08:12:41.297ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2552024-12-21T08:12:41.297ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8aad4b87-ae1f-4f2b-9e2f-c8d82724567e (physical_disk), pool_id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8b45a2fa-928a-4db8-ae2d-410fe5f8c05f (physical_disk), pool_id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 1559ea89-2e98-43d9-be77-7e71cc42a93e (physical_disk), pool_id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 5f04ff51-1a50-4756-93bd-21ba40559315 (physical_disk), pool_id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f0d0eaae-bc11-4cd4-ae5c-ca8402b2f735 (physical_disk), pool_id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a4c0733f-8ad1-43c2-849a-5602ee8075c1 (physical_disk), pool_id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 0bc5b9e9-2e1f-4491-852a-7cb926fc8195 (physical_disk), pool_id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 4e30063c-250f-425a-be1d-a27ee4e36ff6 (physical_disk), pool_id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: f5e32927-adc0-439a-8a2e-2c36958c80c5 (physical_disk), pool_id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2562024-12-21T08:12:41.297ZINFOSledAgent (StorageManager): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-21T08:12:41.297ZINFOSledAgent (StorageManager): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582024-12-21T08:12:41.297ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2592024-12-21T08:12:41.297ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602024-12-21T08:12:41.297ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612024-12-21T08:12:41.297ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622024-12-21T08:12:41.297ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632024-12-21T08:12:41.469ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642024-12-21T08:12:41.469ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool)
2652024-12-21T08:12:41.915ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8722226601379683590 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2662024-12-21T08:12:41.915ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6806315074612528837 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2672024-12-21T08:12:41.916ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2682024-12-21T08:12:42.131ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2692024-12-21T08:12:42.179ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }
2702024-12-21T08:12:42.189ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2712024-12-21T08:12:42.189ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2722024-12-21T08:12:42.189ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2732024-12-21T08:12:42.189ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2742024-12-21T08:12:42.189ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-21T08:12:42.189ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-12-21T08:12:42.189ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2772024-12-21T08:12:42.227ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782024-12-21T08:12:42.236ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone file = sled-storage/src/dataset.rs:302
2792024-12-21T08:12:42.271ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.486793847s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
2802024-12-21T08:12:42.374ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9 file = sled-storage/src/dataset.rs:388
2812024-12-21T08:12:42.382ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2822024-12-21T08:12:42.382ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2832024-12-21T08:12:42.382ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2842024-12-21T08:12:42.382ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2852024-12-21T08:12:42.382ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2862024-12-21T08:12:42.393ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2872024-12-21T08:12:42.393ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool)
2882024-12-21T08:12:42.491ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }
2892024-12-21T08:12:42.498ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2902024-12-21T08:12:42.498ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2912024-12-21T08:12:42.498ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2922024-12-21T08:12:42.498ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2932024-12-21T08:12:42.498ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-12-21T08:12:42.499ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952024-12-21T08:12:42.499ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2962024-12-21T08:12:42.533ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972024-12-21T08:12:42.541ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone file = sled-storage/src/dataset.rs:302
2982024-12-21T08:12:42.680ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf file = sled-storage/src/dataset.rs:388
2992024-12-21T08:12:42.688ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3002024-12-21T08:12:42.688ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3012024-12-21T08:12:42.688ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3022024-12-21T08:12:42.688ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032024-12-21T08:12:42.688ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042024-12-21T08:12:42.698ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3052024-12-21T08:12:42.698ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1f6f464f-c123-4470-96c3-74700df96380 (zpool)
3062024-12-21T08:12:42.792ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }
3072024-12-21T08:12:42.800ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3082024-12-21T08:12:42.800ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3092024-12-21T08:12:42.800ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3102024-12-21T08:12:42.800ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3112024-12-21T08:12:42.800ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-12-21T08:12:42.801ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-12-21T08:12:42.801ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3142024-12-21T08:12:42.835ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152024-12-21T08:12:42.843ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1f6f464f-c123-4470-96c3-74700df96380/crypt/zone file = sled-storage/src/dataset.rs:302
3162024-12-21T08:12:42.919ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
3172024-12-21T08:12:42.984ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1f6f464f-c123-4470-96c3-74700df96380 file = sled-storage/src/dataset.rs:388
3182024-12-21T08:12:42.992ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3192024-12-21T08:12:42.993ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3202024-12-21T08:12:42.993ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3212024-12-21T08:12:42.993ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222024-12-21T08:12:42.993ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232024-12-21T08:12:43.003ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3242024-12-21T08:12:43.003ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool)
3252024-12-21T08:12:43.098ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }
3262024-12-21T08:12:43.106ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3272024-12-21T08:12:43.106ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3282024-12-21T08:12:43.106ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3292024-12-21T08:12:43.106ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3302024-12-21T08:12:43.106ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-12-21T08:12:43.106ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322024-12-21T08:12:43.106ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3332024-12-21T08:12:43.142ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342024-12-21T08:12:43.150ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone file = sled-storage/src/dataset.rs:302
3352024-12-21T08:12:43.281ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e file = sled-storage/src/dataset.rs:388
3362024-12-21T08:12:43.288ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372024-12-21T08:12:43.288ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382024-12-21T08:12:43.288ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392024-12-21T08:12:43.288ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402024-12-21T08:12:43.288ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412024-12-21T08:12:43.299ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3422024-12-21T08:12:43.299ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool)
3432024-12-21T08:12:43.394ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }
3442024-12-21T08:12:43.402ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3452024-12-21T08:12:43.402ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3462024-12-21T08:12:43.402ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3472024-12-21T08:12:43.402ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3482024-12-21T08:12:43.402ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-12-21T08:12:43.402ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502024-12-21T08:12:43.402ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3512024-12-21T08:12:43.437ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522024-12-21T08:12:43.445ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone file = sled-storage/src/dataset.rs:302
3532024-12-21T08:12:43.582ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12 file = sled-storage/src/dataset.rs:388
3542024-12-21T08:12:43.590ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552024-12-21T08:12:43.590ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562024-12-21T08:12:43.590ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572024-12-21T08:12:43.590ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582024-12-21T08:12:43.590ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592024-12-21T08:12:43.599ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3602024-12-21T08:12:43.599ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool)
3612024-12-21T08:12:43.696ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }
3622024-12-21T08:12:43.703ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3632024-12-21T08:12:43.703ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3642024-12-21T08:12:43.703ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3652024-12-21T08:12:43.703ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3662024-12-21T08:12:43.703ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-12-21T08:12:43.704ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-12-21T08:12:43.704ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3692024-12-21T08:12:43.740ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702024-12-21T08:12:43.749ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/zone file = sled-storage/src/dataset.rs:302
3712024-12-21T08:12:43.888ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5c782891-c1e8-4191-bfea-a3d07d39b468 file = sled-storage/src/dataset.rs:388
3722024-12-21T08:12:43.896ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3732024-12-21T08:12:43.896ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3742024-12-21T08:12:43.896ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3752024-12-21T08:12:43.896ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3762024-12-21T08:12:43.896ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3772024-12-21T08:12:43.905ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3782024-12-21T08:12:43.905ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool)
3792024-12-21T08:12:44.002ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }
3802024-12-21T08:12:44.010ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3812024-12-21T08:12:44.010ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3822024-12-21T08:12:44.010ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3832024-12-21T08:12:44.010ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3842024-12-21T08:12:44.010ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-12-21T08:12:44.010ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-12-21T08:12:44.010ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3872024-12-21T08:12:44.014ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
3882024-12-21T08:12:44.047ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-12-21T08:12:44.055ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crypt/zone file = sled-storage/src/dataset.rs:302
3902024-12-21T08:12:44.195ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a file = sled-storage/src/dataset.rs:388
3912024-12-21T08:12:44.202ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922024-12-21T08:12:44.202ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932024-12-21T08:12:44.202ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942024-12-21T08:12:44.202ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952024-12-21T08:12:44.202ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962024-12-21T08:12:44.212ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972024-12-21T08:12:44.212ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool)
3982024-12-21T08:12:44.313ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }
3992024-12-21T08:12:44.321ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4002024-12-21T08:12:44.321ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4012024-12-21T08:12:44.321ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4022024-12-21T08:12:44.321ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4032024-12-21T08:12:44.321ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-12-21T08:12:44.321ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-12-21T08:12:44.321ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4062024-12-21T08:12:44.357ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-12-21T08:12:44.364ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/zone file = sled-storage/src/dataset.rs:302
4082024-12-21T08:12:44.500ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb file = sled-storage/src/dataset.rs:388
4092024-12-21T08:12:44.508ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4102024-12-21T08:12:44.508ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4112024-12-21T08:12:44.508ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4122024-12-21T08:12:44.508ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4132024-12-21T08:12:44.508ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-12-21T08:12:44.517ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4152024-12-21T08:12:44.517ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool)
4162024-12-21T08:12:44.617ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }
4172024-12-21T08:12:44.624ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4182024-12-21T08:12:44.624ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4192024-12-21T08:12:44.624ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4202024-12-21T08:12:44.624ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4212024-12-21T08:12:44.624ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-12-21T08:12:44.624ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-12-21T08:12:44.624ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4242024-12-21T08:12:44.674ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-12-21T08:12:44.684ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/zone file = sled-storage/src/dataset.rs:302
4262024-12-21T08:12:44.820ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f file = sled-storage/src/dataset.rs:388
4272024-12-21T08:12:44.829ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4282024-12-21T08:12:44.829ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4292024-12-21T08:12:44.829ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302024-12-21T08:12:44.829ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a705724f-fca8-4ba5-9e4a-4ba744362879 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 51857ef6-5daa-40cc-b05a-a86adda59be2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4312024-12-21T08:12:44.829ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4322024-12-21T08:12:44.829ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4332024-12-21T08:12:44.829ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342024-12-21T08:12:44.829ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4352024-12-21T08:12:44.829ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4362024-12-21T08:12:44.829ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4372024-12-21T08:12:44.829ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4382024-12-21T08:12:44.829ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4392024-12-21T08:12:44.829ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4402024-12-21T08:12:44.829ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4412024-12-21T08:12:44.830ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4422024-12-21T08:12:44.830ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4432024-12-21T08:12:44.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3532560 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51204 req_id = 408b29f2-519e-4cf0-bc1b-5f64b3b549bc response_code = 200 uri = /omicron-physical-disks
4442024-12-21T08:12:44.861ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01412535-3853-4d5e-8c44-92155e69d0b5 (dataset): DatasetConfig { id: 01412535-3853-4d5e-8c44-92155e69d0b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0828f775-4bc5-4785-b392-1c07331536d2 (dataset): DatasetConfig { id: 0828f775-4bc5-4785-b392-1c07331536d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0aa16249-467c-4e46-a7e1-839487cfac02 (dataset): DatasetConfig { id: 0aa16249-467c-4e46-a7e1-839487cfac02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b79d274-7f3f-43a0-a9a5-7d73534e2e0c (dataset): DatasetConfig { id: 0b79d274-7f3f-43a0-a9a5-7d73534e2e0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1264aed4-33a2-4a62-9126-77a836ee8d9b (dataset): DatasetConfig { id: 1264aed4-33a2-4a62-9126-77a836ee8d9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12e414ff-a0bb-4739-acd5-71fe2d952eba (dataset): DatasetConfig { id: 12e414ff-a0bb-4739-acd5-71fe2d952eba (dataset), name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13ebf206-72bb-4dc7-b120-8f76a8cb3e83 (dataset): DatasetConfig { id: 13ebf206-72bb-4dc7-b120-8f76a8cb3e83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15752002-c7c7-49b0-a322-4e0706dc8719 (dataset): DatasetConfig { id: 15752002-c7c7-49b0-a322-4e0706dc8719 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 161c8768-93b0-4ff9-910c-26fde083a169 (dataset): DatasetConfig { id: 161c8768-93b0-4ff9-910c-26fde083a169 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 194e8e38-7456-4bae-b253-6ff51f7ff4e2 (dataset): DatasetConfig { id: 194e8e38-7456-4bae-b253-6ff51f7ff4e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ae99d11-49dd-43a9-874d-5d6820fb50b5 (dataset): DatasetConfig { id: 1ae99d11-49dd-43a9-874d-5d6820fb50b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22391724-f9af-4a16-899d-240cb38cdec3 (dataset): DatasetConfig { id: 22391724-f9af-4a16-899d-240cb38cdec3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 248dd7cb-2a9d-4618-816b-f6a1e596c163 (dataset): DatasetConfig { id: 248dd7cb-2a9d-4618-816b-f6a1e596c163 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26709161-8163-488a-bb78-c1c9b3861010 (dataset): DatasetConfig { id: 26709161-8163-488a-bb78-c1c9b3861010 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 28e5b72a-19a4-40a4-a527-59f6ea0085b0 (dataset): DatasetConfig { id: 28e5b72a-19a4-40a4-a527-59f6ea0085b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2a8a2433-7c2e-4671-9052-b04af550f1d2 (dataset): DatasetConfig { id: 2a8a2433-7c2e-4671-9052-b04af550f1d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bb84a55-561d-4489-b81c-cd54b01dc807 (dataset): DatasetConfig { id: 2bb84a55-561d-4489-b81c-cd54b01dc807 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 34dd870e-f297-40e8-94b0-d4f6d1a0fd2f (dataset): DatasetConfig { id: 34dd870e-f297-40e8-94b0-d4f6d1a0fd2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bd6e805-df02-4a75-b842-8d696714a70a (dataset): DatasetConfig { id: 3bd6e805-df02-4a75-b842-8d696714a70a (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ce3ca3e-e116-4016-9283-05a6da20e578 (dataset): DatasetConfig { id: 4ce3ca3e-e116-4016-9283-05a6da20e578 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e69474e-b306-46c7-8a27-4b0585ce50ea (dataset): DatasetConfig { id: 4e69474e-b306-46c7-8a27-4b0585ce50ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 565a69ff-1136-4a28-8a30-b65da6118cf3 (dataset): DatasetConfig { id: 565a69ff-1136-4a28-8a30-b65da6118cf3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a6590d2-3a79-4280-862f-af0a97c84317 (dataset): DatasetConfig { id: 5a6590d2-3a79-4280-862f-af0a97c84317 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ae1cacf-dedb-457d-bc3d-85eae76dc80c (dataset): DatasetConfig { id: 5ae1cacf-dedb-457d-bc3d-85eae76dc80c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62a65bc8-966a-4297-9f15-34f2017dcbcf (dataset): DatasetConfig { id: 62a65bc8-966a-4297-9f15-34f2017dcbcf (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68aaf610-ca92-4489-a6b8-9ad07b540394 (dataset): DatasetConfig { id: 68aaf610-ca92-4489-a6b8-9ad07b540394 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c7a4523-8474-4b11-9e60-c988e6169b95 (dataset): DatasetConfig { id: 6c7a4523-8474-4b11-9e60-c988e6169b95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 77786f1d-55cc-4090-b567-e4486a0c8e80 (dataset): DatasetConfig { id: 77786f1d-55cc-4090-b567-e4486a0c8e80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77f23790-0ca2-4cde-8e49-cb435616091a (dataset): DatasetConfig { id: 77f23790-0ca2-4cde-8e49-cb435616091a (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 785f1671-49ed-4b2c-ba03-f036067fec39 (dataset): DatasetConfig { id: 785f1671-49ed-4b2c-ba03-f036067fec39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 793d1ed2-ca84-49a0-b5c4-e30221db5448 (dataset): DatasetConfig { id: 793d1ed2-ca84-49a0-b5c4-e30221db5448 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cbe28d2-8c05-4231-8420-6dbd942a2e3b (dataset): DatasetConfig { id: 7cbe28d2-8c05-4231-8420-6dbd942a2e3b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e94953a-9069-43a7-bb02-c11f68473208 (dataset): DatasetConfig { id: 8e94953a-9069-43a7-bb02-c11f68473208 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92db5ce6-88e5-43ab-9fde-55dfb3a82ad1 (dataset): DatasetConfig { id: 92db5ce6-88e5-43ab-9fde-55dfb3a82ad1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97a3f53b-0e2f-430d-b557-36dc2791c91f (dataset): DatasetConfig { id: 97a3f53b-0e2f-430d-b557-36dc2791c91f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c14a123-a586-4b01-8cc7-d5f365af54ef (dataset): DatasetConfig { id: 9c14a123-a586-4b01-8cc7-d5f365af54ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f86239d-ba66-451d-8b3c-ef495c343053 (dataset): DatasetConfig { id: 9f86239d-ba66-451d-8b3c-ef495c343053 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fa46c6c-95a7-4f82-a312-8a2671531121 (dataset): DatasetConfig { id: 9fa46c6c-95a7-4f82-a312-8a2671531121 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a12a219f-dc7a-4c4c-8af5-7b0fe1d7406f (dataset): DatasetConfig { id: a12a219f-dc7a-4c4c-8af5-7b0fe1d7406f (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a361d843-d903-4701-8c38-e5e27f0ed94b (dataset): DatasetConfig { id: a361d843-d903-4701-8c38-e5e27f0ed94b (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aab6c42b-4f1c-4ec5-a83d-88ca97bf8612 (dataset): DatasetConfig { id: aab6c42b-4f1c-4ec5-a83d-88ca97bf8612 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3fa9c33-7b37-456c-8d59-1116899d2752 (dataset): DatasetConfig { id: b3fa9c33-7b37-456c-8d59-1116899d2752 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b82f2706-80be-45a1-8114-88d1402eb501 (dataset): DatasetConfig { id: b82f2706-80be-45a1-8114-88d1402eb501 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8fb3add-bf4c-4533-b50e-3192db4c4c8e (dataset): DatasetConfig { id: b8fb3add-bf4c-4533-b50e-3192db4c4c8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9a34b67-65a5-4a25-8783-72bc323dee47 (dataset): DatasetConfig { id: b9a34b67-65a5-4a25-8783-72bc323dee47 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba8caa50-feb2-4594-91dd-a9db3150795f (dataset): DatasetConfig { id: ba8caa50-feb2-4594-91dd-a9db3150795f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c390ea94-b7d9-4ab4-b672-36496e1d8eda (dataset): DatasetConfig { id: c390ea94-b7d9-4ab4-b672-36496e1d8eda (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5e9ed9c-9f23-4e48-9635-9126322c030c (dataset): DatasetConfig { id: c5e9ed9c-9f23-4e48-9635-9126322c030c (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, caa4c01e-f461-42fe-9ee2-ed4c32227411 (dataset): DatasetConfig { id: caa4c01e-f461-42fe-9ee2-ed4c32227411 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b06f2be2-d169-4e82-b379-936275958456" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d01ee13e-cbdd-4699-80a2-ab8cff38389f (dataset): DatasetConfig { id: d01ee13e-cbdd-4699-80a2-ab8cff38389f (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d774524c-07ee-4dd1-9f6e-e4dd51f61183 (dataset): DatasetConfig { id: d774524c-07ee-4dd1-9f6e-e4dd51f61183 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, df4fc7a4-17a6-4b9d-9968-abd9741724bc (dataset): DatasetConfig { id: df4fc7a4-17a6-4b9d-9968-abd9741724bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfec1b4e-8bc8-4f6e-b95f-4f1f400c18e3 (dataset): DatasetConfig { id: dfec1b4e-8bc8-4f6e-b95f-4f1f400c18e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e333670d-5f19-40b3-b1e8-03346cb132c1 (dataset): DatasetConfig { id: e333670d-5f19-40b3-b1e8-03346cb132c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e64b9a61-642f-4cf8-a374-796edcc4c2b5 (dataset): DatasetConfig { id: e64b9a61-642f-4cf8-a374-796edcc4c2b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e852ed38-45a9-43db-b8cb-821da46468ef (dataset): DatasetConfig { id: e852ed38-45a9-43db-b8cb-821da46468ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9e635d1-c01d-4d15-becf-81e553b20019 (dataset): DatasetConfig { id: e9e635d1-c01d-4d15-becf-81e553b20019 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea58a9ce-f1d8-4bc6-a6ae-d7fbdc62bfb9 (dataset): DatasetConfig { id: ea58a9ce-f1d8-4bc6-a6ae-d7fbdc62bfb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ee96f0f2-ceca-4440-8dd3-dc3b4e1baa21 (dataset): DatasetConfig { id: ee96f0f2-ceca-4440-8dd3-dc3b4e1baa21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eebb79b3-9747-4dec-b309-2e7cbb4f5a56 (dataset): DatasetConfig { id: eebb79b3-9747-4dec-b309-2e7cbb4f5a56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1a0504a-2e79-4395-8035-b397296d0696 (dataset): DatasetConfig { id: f1a0504a-2e79-4395-8035-b397296d0696 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4251bff-01da-4120-b50f-d47e949df9f0 (dataset): DatasetConfig { id: f4251bff-01da-4120-b50f-d47e949df9f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4a68238-b430-4d07-bfe4-47ea027e3d39 (dataset): DatasetConfig { id: f4a68238-b430-4d07-bfe4-47ea027e3d39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4b53468-f4c2-4ea6-8b74-39da87594d02 (dataset): DatasetConfig { id: f4b53468-f4c2-4ea6-8b74-39da87594d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe4bf83b-a6bc-48bf-a9a2-9274755aa8fe (dataset): DatasetConfig { id: fe4bf83b-a6bc-48bf-a9a2-9274755aa8fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe4d9e1d-1d99-4582-ae2d-a72ed680d033 (dataset): DatasetConfig { id: fe4d9e1d-1d99-4582-ae2d-a72ed680d033 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4452024-12-21T08:12:44.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33472
4462024-12-21T08:12:44.862ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4472024-12-21T08:12:44.862ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01412535-3853-4d5e-8c44-92155e69d0b5 (dataset): DatasetConfig { id: 01412535-3853-4d5e-8c44-92155e69d0b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0828f775-4bc5-4785-b392-1c07331536d2 (dataset): DatasetConfig { id: 0828f775-4bc5-4785-b392-1c07331536d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0aa16249-467c-4e46-a7e1-839487cfac02 (dataset): DatasetConfig { id: 0aa16249-467c-4e46-a7e1-839487cfac02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b79d274-7f3f-43a0-a9a5-7d73534e2e0c (dataset): DatasetConfig { id: 0b79d274-7f3f-43a0-a9a5-7d73534e2e0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1264aed4-33a2-4a62-9126-77a836ee8d9b (dataset): DatasetConfig { id: 1264aed4-33a2-4a62-9126-77a836ee8d9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12e414ff-a0bb-4739-acd5-71fe2d952eba (dataset): DatasetConfig { id: 12e414ff-a0bb-4739-acd5-71fe2d952eba (dataset), name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13ebf206-72bb-4dc7-b120-8f76a8cb3e83 (dataset): DatasetConfig { id: 13ebf206-72bb-4dc7-b120-8f76a8cb3e83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15752002-c7c7-49b0-a322-4e0706dc8719 (dataset): DatasetConfig { id: 15752002-c7c7-49b0-a322-4e0706dc8719 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 161c8768-93b0-4ff9-910c-26fde083a169 (dataset): DatasetConfig { id: 161c8768-93b0-4ff9-910c-26fde083a169 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 194e8e38-7456-4bae-b253-6ff51f7ff4e2 (dataset): DatasetConfig { id: 194e8e38-7456-4bae-b253-6ff51f7ff4e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ae99d11-49dd-43a9-874d-5d6820fb50b5 (dataset): DatasetConfig { id: 1ae99d11-49dd-43a9-874d-5d6820fb50b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22391724-f9af-4a16-899d-240cb38cdec3 (dataset): DatasetConfig { id: 22391724-f9af-4a16-899d-240cb38cdec3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 248dd7cb-2a9d-4618-816b-f6a1e596c163 (dataset): DatasetConfig { id: 248dd7cb-2a9d-4618-816b-f6a1e596c163 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26709161-8163-488a-bb78-c1c9b3861010 (dataset): DatasetConfig { id: 26709161-8163-488a-bb78-c1c9b3861010 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 28e5b72a-19a4-40a4-a527-59f6ea0085b0 (dataset): DatasetConfig { id: 28e5b72a-19a4-40a4-a527-59f6ea0085b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2a8a2433-7c2e-4671-9052-b04af550f1d2 (dataset): DatasetConfig { id: 2a8a2433-7c2e-4671-9052-b04af550f1d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bb84a55-561d-4489-b81c-cd54b01dc807 (dataset): DatasetConfig { id: 2bb84a55-561d-4489-b81c-cd54b01dc807 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 34dd870e-f297-40e8-94b0-d4f6d1a0fd2f (dataset): DatasetConfig { id: 34dd870e-f297-40e8-94b0-d4f6d1a0fd2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bd6e805-df02-4a75-b842-8d696714a70a (dataset): DatasetConfig { id: 3bd6e805-df02-4a75-b842-8d696714a70a (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ce3ca3e-e116-4016-9283-05a6da20e578 (dataset): DatasetConfig { id: 4ce3ca3e-e116-4016-9283-05a6da20e578 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e69474e-b306-46c7-8a27-4b0585ce50ea (dataset): DatasetConfig { id: 4e69474e-b306-46c7-8a27-4b0585ce50ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 565a69ff-1136-4a28-8a30-b65da6118cf3 (dataset): DatasetConfig { id: 565a69ff-1136-4a28-8a30-b65da6118cf3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a6590d2-3a79-4280-862f-af0a97c84317 (dataset): DatasetConfig { id: 5a6590d2-3a79-4280-862f-af0a97c84317 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ae1cacf-dedb-457d-bc3d-85eae76dc80c (dataset): DatasetConfig { id: 5ae1cacf-dedb-457d-bc3d-85eae76dc80c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62a65bc8-966a-4297-9f15-34f2017dcbcf (dataset): DatasetConfig { id: 62a65bc8-966a-4297-9f15-34f2017dcbcf (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68aaf610-ca92-4489-a6b8-9ad07b540394 (dataset): DatasetConfig { id: 68aaf610-ca92-4489-a6b8-9ad07b540394 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c7a4523-8474-4b11-9e60-c988e6169b95 (dataset): DatasetConfig { id: 6c7a4523-8474-4b11-9e60-c988e6169b95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 77786f1d-55cc-4090-b567-e4486a0c8e80 (dataset): DatasetConfig { id: 77786f1d-55cc-4090-b567-e4486a0c8e80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77f23790-0ca2-4cde-8e49-cb435616091a (dataset): DatasetConfig { id: 77f23790-0ca2-4cde-8e49-cb435616091a (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 785f1671-49ed-4b2c-ba03-f036067fec39 (dataset): DatasetConfig { id: 785f1671-49ed-4b2c-ba03-f036067fec39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 793d1ed2-ca84-49a0-b5c4-e30221db5448 (dataset): DatasetConfig { id: 793d1ed2-ca84-49a0-b5c4-e30221db5448 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cbe28d2-8c05-4231-8420-6dbd942a2e3b (dataset): DatasetConfig { id: 7cbe28d2-8c05-4231-8420-6dbd942a2e3b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e94953a-9069-43a7-bb02-c11f68473208 (dataset): DatasetConfig { id: 8e94953a-9069-43a7-bb02-c11f68473208 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92db5ce6-88e5-43ab-9fde-55dfb3a82ad1 (dataset): DatasetConfig { id: 92db5ce6-88e5-43ab-9fde-55dfb3a82ad1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97a3f53b-0e2f-430d-b557-36dc2791c91f (dataset): DatasetConfig { id: 97a3f53b-0e2f-430d-b557-36dc2791c91f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c14a123-a586-4b01-8cc7-d5f365af54ef (dataset): DatasetConfig { id: 9c14a123-a586-4b01-8cc7-d5f365af54ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f86239d-ba66-451d-8b3c-ef495c343053 (dataset): DatasetConfig { id: 9f86239d-ba66-451d-8b3c-ef495c343053 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fa46c6c-95a7-4f82-a312-8a2671531121 (dataset): DatasetConfig { id: 9fa46c6c-95a7-4f82-a312-8a2671531121 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a12a219f-dc7a-4c4c-8af5-7b0fe1d7406f (dataset): DatasetConfig { id: a12a219f-dc7a-4c4c-8af5-7b0fe1d7406f (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a361d843-d903-4701-8c38-e5e27f0ed94b (dataset): DatasetConfig { id: a361d843-d903-4701-8c38-e5e27f0ed94b (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aab6c42b-4f1c-4ec5-a83d-88ca97bf8612 (dataset): DatasetConfig { id: aab6c42b-4f1c-4ec5-a83d-88ca97bf8612 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3fa9c33-7b37-456c-8d59-1116899d2752 (dataset): DatasetConfig { id: b3fa9c33-7b37-456c-8d59-1116899d2752 (dataset), name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b82f2706-80be-45a1-8114-88d1402eb501 (dataset): DatasetConfig { id: b82f2706-80be-45a1-8114-88d1402eb501 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8fb3add-bf4c-4533-b50e-3192db4c4c8e (dataset): DatasetConfig { id: b8fb3add-bf4c-4533-b50e-3192db4c4c8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9a34b67-65a5-4a25-8783-72bc323dee47 (dataset): DatasetConfig { id: b9a34b67-65a5-4a25-8783-72bc323dee47 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba8caa50-feb2-4594-91dd-a9db3150795f (dataset): DatasetConfig { id: ba8caa50-feb2-4594-91dd-a9db3150795f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c390ea94-b7d9-4ab4-b672-36496e1d8eda (dataset): DatasetConfig { id: c390ea94-b7d9-4ab4-b672-36496e1d8eda (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5e9ed9c-9f23-4e48-9635-9126322c030c (dataset): DatasetConfig { id: c5e9ed9c-9f23-4e48-9635-9126322c030c (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, caa4c01e-f461-42fe-9ee2-ed4c32227411 (dataset): DatasetConfig { id: caa4c01e-f461-42fe-9ee2-ed4c32227411 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b06f2be2-d169-4e82-b379-936275958456" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d01ee13e-cbdd-4699-80a2-ab8cff38389f (dataset): DatasetConfig { id: d01ee13e-cbdd-4699-80a2-ab8cff38389f (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d774524c-07ee-4dd1-9f6e-e4dd51f61183 (dataset): DatasetConfig { id: d774524c-07ee-4dd1-9f6e-e4dd51f61183 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, df4fc7a4-17a6-4b9d-9968-abd9741724bc (dataset): DatasetConfig { id: df4fc7a4-17a6-4b9d-9968-abd9741724bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfec1b4e-8bc8-4f6e-b95f-4f1f400c18e3 (dataset): DatasetConfig { id: dfec1b4e-8bc8-4f6e-b95f-4f1f400c18e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e333670d-5f19-40b3-b1e8-03346cb132c1 (dataset): DatasetConfig { id: e333670d-5f19-40b3-b1e8-03346cb132c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e64b9a61-642f-4cf8-a374-796edcc4c2b5 (dataset): DatasetConfig { id: e64b9a61-642f-4cf8-a374-796edcc4c2b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e852ed38-45a9-43db-b8cb-821da46468ef (dataset): DatasetConfig { id: e852ed38-45a9-43db-b8cb-821da46468ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9e635d1-c01d-4d15-becf-81e553b20019 (dataset): DatasetConfig { id: e9e635d1-c01d-4d15-becf-81e553b20019 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea58a9ce-f1d8-4bc6-a6ae-d7fbdc62bfb9 (dataset): DatasetConfig { id: ea58a9ce-f1d8-4bc6-a6ae-d7fbdc62bfb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ee96f0f2-ceca-4440-8dd3-dc3b4e1baa21 (dataset): DatasetConfig { id: ee96f0f2-ceca-4440-8dd3-dc3b4e1baa21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eebb79b3-9747-4dec-b309-2e7cbb4f5a56 (dataset): DatasetConfig { id: eebb79b3-9747-4dec-b309-2e7cbb4f5a56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1a0504a-2e79-4395-8035-b397296d0696 (dataset): DatasetConfig { id: f1a0504a-2e79-4395-8035-b397296d0696 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4251bff-01da-4120-b50f-d47e949df9f0 (dataset): DatasetConfig { id: f4251bff-01da-4120-b50f-d47e949df9f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4a68238-b430-4d07-bfe4-47ea027e3d39 (dataset): DatasetConfig { id: f4a68238-b430-4d07-bfe4-47ea027e3d39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4b53468-f4c2-4ea6-8b74-39da87594d02 (dataset): DatasetConfig { id: f4b53468-f4c2-4ea6-8b74-39da87594d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe4bf83b-a6bc-48bf-a9a2-9274755aa8fe (dataset): DatasetConfig { id: fe4bf83b-a6bc-48bf-a9a2-9274755aa8fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe4d9e1d-1d99-4582-ae2d-a72ed680d033 (dataset): DatasetConfig { id: fe4d9e1d-1d99-4582-ae2d-a72ed680d033 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4482024-12-21T08:12:44.862ZINFOSledAgent (StorageManager): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492024-12-21T08:12:44.862ZINFOSledAgent (StorageManager): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502024-12-21T08:12:44.862ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4512024-12-21T08:12:44.878ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522024-12-21T08:12:44.878ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532024-12-21T08:12:44.878ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c782891-c1e8-4191-bfea-a3d07d39b468/crucible" } file = sled-storage/src/manager.rs:1431
4542024-12-21T08:12:44.927ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552024-12-21T08:12:44.927ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4562024-12-21T08:12:44.927ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/debug"), full_name: "oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/debug" } file = sled-storage/src/manager.rs:1431
4572024-12-21T08:12:44.956ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582024-12-21T08:12:44.956ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592024-12-21T08:12:44.956ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone/oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0"), full_name: "oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone/oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0" } file = sled-storage/src/manager.rs:1431
4602024-12-21T08:12:45.015ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
4612024-12-21T08:12:45.018ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622024-12-21T08:12:45.018ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4632024-12-21T08:12:45.018ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/debug"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/debug" } file = sled-storage/src/manager.rs:1431
4642024-12-21T08:12:45.049ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652024-12-21T08:12:45.050ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662024-12-21T08:12:45.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crucible" } file = sled-storage/src/manager.rs:1431
4672024-12-21T08:12:45.099ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682024-12-21T08:12:45.099ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4692024-12-21T08:12:45.099ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crypt/zone"), full_name: "oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crypt/zone" } file = sled-storage/src/manager.rs:1431
4702024-12-21T08:12:45.130ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712024-12-21T08:12:45.130ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722024-12-21T08:12:45.130ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone/oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67"), full_name: "oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone/oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67" } file = sled-storage/src/manager.rs:1431
4732024-12-21T08:12:45.193ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742024-12-21T08:12:45.193ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752024-12-21T08:12:45.193ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f6f464f-c123-4470-96c3-74700df96380/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4762024-12-21T08:12:45.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772024-12-21T08:12:45.244ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782024-12-21T08:12:45.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f6f464f-c123-4470-96c3-74700df96380/crypt/zone/oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417"), full_name: "oxp_1f6f464f-c123-4470-96c3-74700df96380/crypt/zone/oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417" } file = sled-storage/src/manager.rs:1431
4792024-12-21T08:12:45.304ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802024-12-21T08:12:45.304ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4812024-12-21T08:12:45.304ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f6f464f-c123-4470-96c3-74700df96380/crypt/zone"), full_name: "oxp_1f6f464f-c123-4470-96c3-74700df96380/crypt/zone" } file = sled-storage/src/manager.rs:1431
4822024-12-21T08:12:45.333ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832024-12-21T08:12:45.333ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842024-12-21T08:12:45.333ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/zone/oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), full_name: "oxp_5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/zone/oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba" } file = sled-storage/src/manager.rs:1431
4852024-12-21T08:12:45.392ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862024-12-21T08:12:45.392ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4872024-12-21T08:12:45.392ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/debug"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/debug" } file = sled-storage/src/manager.rs:1431
4882024-12-21T08:12:45.421ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892024-12-21T08:12:45.422ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902024-12-21T08:12:45.422ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crucible" } file = sled-storage/src/manager.rs:1431
4912024-12-21T08:12:45.472ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922024-12-21T08:12:45.472ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932024-12-21T08:12:45.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4942024-12-21T08:12:45.521ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952024-12-21T08:12:45.521ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4962024-12-21T08:12:45.521ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/debug"), full_name: "oxp_5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/debug" } file = sled-storage/src/manager.rs:1431
4972024-12-21T08:12:45.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982024-12-21T08:12:45.550ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992024-12-21T08:12:45.550ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone/oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone/oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17" } file = sled-storage/src/manager.rs:1431
5002024-12-21T08:12:45.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012024-12-21T08:12:45.612ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5022024-12-21T08:12:45.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/debug"), full_name: "oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/debug" } file = sled-storage/src/manager.rs:1431
5032024-12-21T08:12:45.641ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042024-12-21T08:12:45.641ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052024-12-21T08:12:45.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crucible" } file = sled-storage/src/manager.rs:1431
5062024-12-21T08:12:45.689ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072024-12-21T08:12:45.689ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5082024-12-21T08:12:45.689ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone" } file = sled-storage/src/manager.rs:1431
5092024-12-21T08:12:45.717ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102024-12-21T08:12:45.717ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112024-12-21T08:12:45.717ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5122024-12-21T08:12:45.767ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132024-12-21T08:12:45.767ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142024-12-21T08:12:45.767ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone/oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone/oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b" } file = sled-storage/src/manager.rs:1431
5152024-12-21T08:12:45.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162024-12-21T08:12:45.829ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5172024-12-21T08:12:45.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone" } file = sled-storage/src/manager.rs:1431
5182024-12-21T08:12:45.859ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192024-12-21T08:12:45.859ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202024-12-21T08:12:45.859ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f6f464f-c123-4470-96c3-74700df96380/crypt/zone/oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb"), full_name: "oxp_1f6f464f-c123-4470-96c3-74700df96380/crypt/zone/oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb" } file = sled-storage/src/manager.rs:1431
5212024-12-21T08:12:45.918ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222024-12-21T08:12:45.918ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5232024-12-21T08:12:45.918ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/zone"), full_name: "oxp_5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/zone" } file = sled-storage/src/manager.rs:1431
5242024-12-21T08:12:45.948ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252024-12-21T08:12:45.948ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262024-12-21T08:12:45.948ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f" } file = sled-storage/src/manager.rs:1431
5272024-12-21T08:12:46.008ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282024-12-21T08:12:46.008ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292024-12-21T08:12:46.008ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone/oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), full_name: "oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone/oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052" } file = sled-storage/src/manager.rs:1431
5302024-12-21T08:12:46.021ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
5312024-12-21T08:12:46.071ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322024-12-21T08:12:46.071ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5332024-12-21T08:12:46.071ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f6f464f-c123-4470-96c3-74700df96380/crypt/debug"), full_name: "oxp_1f6f464f-c123-4470-96c3-74700df96380/crypt/debug" } file = sled-storage/src/manager.rs:1431
5342024-12-21T08:12:46.100ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352024-12-21T08:12:46.100ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362024-12-21T08:12:46.100ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/zone/oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47"), full_name: "oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/zone/oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47" } file = sled-storage/src/manager.rs:1431
5372024-12-21T08:12:46.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382024-12-21T08:12:46.159ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392024-12-21T08:12:46.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5402024-12-21T08:12:46.209ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412024-12-21T08:12:46.209ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5422024-12-21T08:12:46.209ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/debug"), full_name: "oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/debug" } file = sled-storage/src/manager.rs:1431
5432024-12-21T08:12:46.238ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442024-12-21T08:12:46.238ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452024-12-21T08:12:46.238ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f6f464f-c123-4470-96c3-74700df96380/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5462024-12-21T08:12:46.291ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472024-12-21T08:12:46.291ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482024-12-21T08:12:46.291ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crucible" } file = sled-storage/src/manager.rs:1431
5492024-12-21T08:12:46.340ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502024-12-21T08:12:46.340ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512024-12-21T08:12:46.340ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone/oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed"), full_name: "oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone/oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed" } file = sled-storage/src/manager.rs:1431
5522024-12-21T08:12:46.399ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532024-12-21T08:12:46.399ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542024-12-21T08:12:46.399ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f6f464f-c123-4470-96c3-74700df96380/crypt/zone/oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0"), full_name: "oxp_1f6f464f-c123-4470-96c3-74700df96380/crypt/zone/oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0" } file = sled-storage/src/manager.rs:1431
5552024-12-21T08:12:46.461ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562024-12-21T08:12:46.461ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572024-12-21T08:12:46.461ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/zone/oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915"), full_name: "oxp_5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/zone/oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915" } file = sled-storage/src/manager.rs:1431
5582024-12-21T08:12:46.521ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592024-12-21T08:12:46.521ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602024-12-21T08:12:46.521ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/zone/oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f"), full_name: "oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/zone/oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f" } file = sled-storage/src/manager.rs:1431
5612024-12-21T08:12:46.582ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622024-12-21T08:12:46.582ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632024-12-21T08:12:46.582ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crucible" } file = sled-storage/src/manager.rs:1431
5642024-12-21T08:12:46.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652024-12-21T08:12:46.631ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662024-12-21T08:12:46.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/zone/oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574"), full_name: "oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/zone/oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574" } file = sled-storage/src/manager.rs:1431
5672024-12-21T08:12:46.690ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682024-12-21T08:12:46.690ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692024-12-21T08:12:46.690ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone/oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone/oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a" } file = sled-storage/src/manager.rs:1431
5702024-12-21T08:12:46.750ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712024-12-21T08:12:46.750ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5722024-12-21T08:12:46.750ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/zone"), full_name: "oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/zone" } file = sled-storage/src/manager.rs:1431
5732024-12-21T08:12:46.780ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742024-12-21T08:12:46.780ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752024-12-21T08:12:46.780ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone/oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/zone/oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f" } file = sled-storage/src/manager.rs:1431
5762024-12-21T08:12:46.839ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772024-12-21T08:12:46.839ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782024-12-21T08:12:46.839ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5792024-12-21T08:12:46.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802024-12-21T08:12:46.891ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812024-12-21T08:12:46.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155" } file = sled-storage/src/manager.rs:1431
5822024-12-21T08:12:46.951ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832024-12-21T08:12:46.951ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842024-12-21T08:12:46.951ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6" } file = sled-storage/src/manager.rs:1431
5852024-12-21T08:12:47.013ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862024-12-21T08:12:47.013ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872024-12-21T08:12:47.013ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone/oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c"), full_name: "oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone/oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c" } file = sled-storage/src/manager.rs:1431
5882024-12-21T08:12:47.024ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
5892024-12-21T08:12:47.077ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902024-12-21T08:12:47.077ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912024-12-21T08:12:47.077ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone/oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f"), full_name: "oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone/oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f" } file = sled-storage/src/manager.rs:1431
5922024-12-21T08:12:47.138ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932024-12-21T08:12:47.138ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942024-12-21T08:12:47.138ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5952024-12-21T08:12:47.189ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962024-12-21T08:12:47.189ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972024-12-21T08:12:47.189ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5982024-12-21T08:12:47.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992024-12-21T08:12:47.239ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002024-12-21T08:12:47.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/zone/oxz_crucible_b06f2be2-d169-4e82-b379-936275958456"), full_name: "oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/zone/oxz_crucible_b06f2be2-d169-4e82-b379-936275958456" } file = sled-storage/src/manager.rs:1431
6012024-12-21T08:12:47.298ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022024-12-21T08:12:47.298ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6032024-12-21T08:12:47.298ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone/oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da"), full_name: "oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone/oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da" } file = sled-storage/src/manager.rs:1431
6042024-12-21T08:12:47.357ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052024-12-21T08:12:47.357ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6062024-12-21T08:12:47.357ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crypt/debug"), full_name: "oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crypt/debug" } file = sled-storage/src/manager.rs:1431
6072024-12-21T08:12:47.387ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082024-12-21T08:12:47.387ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6092024-12-21T08:12:47.387ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone"), full_name: "oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/zone" } file = sled-storage/src/manager.rs:1431
6102024-12-21T08:12:47.417ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112024-12-21T08:12:47.417ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6122024-12-21T08:12:47.417ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone"), full_name: "oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone" } file = sled-storage/src/manager.rs:1431
6132024-12-21T08:12:47.446ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142024-12-21T08:12:47.446ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6152024-12-21T08:12:47.446ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/zone"), full_name: "oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/zone" } file = sled-storage/src/manager.rs:1431
6162024-12-21T08:12:47.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172024-12-21T08:12:47.475ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182024-12-21T08:12:47.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone/oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2"), full_name: "oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/zone/oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2" } file = sled-storage/src/manager.rs:1431
6192024-12-21T08:12:47.534ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202024-12-21T08:12:47.534ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212024-12-21T08:12:47.534ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5" } file = sled-storage/src/manager.rs:1431
6222024-12-21T08:12:47.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232024-12-21T08:12:47.595ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242024-12-21T08:12:47.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662" } file = sled-storage/src/manager.rs:1431
6252024-12-21T08:12:47.655ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262024-12-21T08:12:47.655ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6272024-12-21T08:12:47.655ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/debug"), full_name: "oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/debug" } file = sled-storage/src/manager.rs:1431
6282024-12-21T08:12:47.686ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292024-12-21T08:12:47.686ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302024-12-21T08:12:47.686ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6312024-12-21T08:12:47.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322024-12-21T08:12:47.739ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332024-12-21T08:12:47.739ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible" } file = sled-storage/src/manager.rs:1431
6342024-12-21T08:12:47.788ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352024-12-21T08:12:47.788ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362024-12-21T08:12:47.788ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb/crucible" } file = sled-storage/src/manager.rs:1431
6372024-12-21T08:12:47.837ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382024-12-21T08:12:47.838ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392024-12-21T08:12:47.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6402024-12-21T08:12:47.889ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412024-12-21T08:12:47.889ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422024-12-21T08:12:47.889ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crucible" } file = sled-storage/src/manager.rs:1431
6432024-12-21T08:12:47.939ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442024-12-21T08:12:47.939ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452024-12-21T08:12:47.939ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/zone/oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9" } file = sled-storage/src/manager.rs:1431
6462024-12-21T08:12:48.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472024-12-21T08:12:48.001ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482024-12-21T08:12:48.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crypt/zone/oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e"), full_name: "oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crypt/zone/oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e" } file = sled-storage/src/manager.rs:1431
6492024-12-21T08:12:48.026ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
6502024-12-21T08:12:48.063ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6512024-12-21T08:12:48.063ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6522024-12-21T08:12:48.063ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6532024-12-21T08:12:48.113ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542024-12-21T08:12:48.114ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552024-12-21T08:12:48.114ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
6562024-12-21T08:12:48.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3252531 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33472 req_id = 86462994-c005-4e01-8696-514bc4f7e8cc response_code = 200 uri = /datasets
6572024-12-21T08:12:48.146ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 3a5d45b5-93a4-4310-9d89-08a86d70030f (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 886f4d56-e81e-4132-b564-bc0136a38f4a (service), filesystem_pool: Some(ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ca884540-0d66-44e4-9133-f0aa43d52417 (service), filesystem_pool: Some(ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6582024-12-21T08:12:48.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47325
6592024-12-21T08:12:48.146ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602024-12-21T08:12:48.146ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-12-21T08:12:48.156ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622024-12-21T08:12:48.156ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-12-21T08:12:48.164ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642024-12-21T08:12:48.164ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652024-12-21T08:12:48.173ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662024-12-21T08:12:48.173ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:188
6672024-12-21T08:12:48.173ZINFOSledAgent (ServiceManager): No ledger in /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:188
6682024-12-21T08:12:48.173ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-21T08:12:48.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-21T08:12:48.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712024-12-21T08:12:48.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722024-12-21T08:12:48.277ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417 file = illumos-utils/src/zone.rs:325
6732024-12-21T08:12:48.281ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f file = illumos-utils/src/zone.rs:325
6742024-12-21T08:12:48.286ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a file = illumos-utils/src/zone.rs:325
6752024-12-21T08:12:48.299ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417 file = illumos-utils/src/zone.rs:363
6762024-12-21T08:12:48.303ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f file = illumos-utils/src/zone.rs:363
6772024-12-21T08:12:48.307ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a file = illumos-utils/src/zone.rs:363
6782024-12-21T08:12:49.028ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
6792024-12-21T08:12:49.880ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-12-21T08:12:49.880ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6812024-12-21T08:12:49.880ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
6822024-12-21T08:12:50.366ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-12-21T08:12:50.700ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1379334908166363263 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
6842024-12-21T08:12:50.700ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13072910765903461688 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
6852024-12-21T08:12:50.785ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6862024-12-21T08:12:50.785ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6872024-12-21T08:12:50.791ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6882024-12-21T08:12:50.791ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6892024-12-21T08:12:50.849ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6902024-12-21T08:12:50.849ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6912024-12-21T08:12:50.849ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6922024-12-21T08:12:50.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 69.511041ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
6932024-12-21T08:12:50.860ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
6942024-12-21T08:12:50.866ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
6952024-12-21T08:12:50.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 83.462156ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
6962024-12-21T08:12:50.945ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
6972024-12-21T08:12:50.945ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
6982024-12-21T08:12:50.990ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
6992024-12-21T08:12:50.990ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
7002024-12-21T08:12:51.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 51.095336ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7012024-12-21T08:12:51.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 60.186019ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7022024-12-21T08:12:51.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 146.862841ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7032024-12-21T08:12:51.042ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7042024-12-21T08:12:51.043ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7052024-12-21T08:12:51.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 51.754255ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7062024-12-21T08:12:51.062ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7072024-12-21T08:12:51.062ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7082024-12-21T08:12:51.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 140.355069ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7092024-12-21T08:12:51.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 251.34004ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7102024-12-21T08:12:51.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 470.425815ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7112024-12-21T08:12:51.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 233.492855ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7122024-12-21T08:12:51.425ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7132024-12-21T08:12:51.425ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7142024-12-21T08:12:51.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 414.098095ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7152024-12-21T08:12:51.552ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7162024-12-21T08:12:51.552ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7172024-12-21T08:12:51.594ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7182024-12-21T08:12:51.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 207.906105ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7192024-12-21T08:12:51.642ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7202024-12-21T08:12:51.642ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7212024-12-21T08:12:51.642ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7222024-12-21T08:12:51.642ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7232024-12-21T08:12:51.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 642.780347ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7242024-12-21T08:12:51.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7252024-12-21T08:12:51.742ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7262024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472024-12-21T08:12:51.742ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482024-12-21T08:12:51.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 1.052701337s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7492024-12-21T08:12:51.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 689.002088ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7502024-12-21T08:12:51.917ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8722226601379683590 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
7512024-12-21T08:12:51.917ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6806315074612528837 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
7522024-12-21T08:12:52.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 1.441091742s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7532024-12-21T08:12:52.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 510.20678ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7542024-12-21T08:12:52.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 752.206691ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7552024-12-21T08:12:53.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 1.009095471s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7562024-12-21T08:12:53.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 871.70076ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7572024-12-21T08:12:53.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 624.087502ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7582024-12-21T08:12:54.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 578.675895ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7592024-12-21T08:12:54.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 746.396647ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7602024-12-21T08:12:54.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 1.225348954s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7612024-12-21T08:12:54.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 1.428775836s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7622024-12-21T08:12:55.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 786.931782ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7632024-12-21T08:12:55.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 1.097828855s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7642024-12-21T08:12:55.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 1.155025441s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7652024-12-21T08:12:56.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 1.405866857s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7662024-12-21T08:12:56.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 1.449792481s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7672024-12-21T08:12:57.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 676.211683ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7682024-12-21T08:12:57.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 1.044727856s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7692024-12-21T08:12:57.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 890.400044ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7702024-12-21T08:12:58.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 954.981946ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7712024-12-21T08:12:58.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 528.329888ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7722024-12-21T08:12:58.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 1.252449768s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7732024-12-21T08:12:59.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 1.086585421s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7742024-12-21T08:12:59.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 549.217071ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7752024-12-21T08:12:59.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 1.434812193s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7762024-12-21T08:12:59.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 1.306512137s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7772024-12-21T08:13:00.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 1.34142407s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7782024-12-21T08:13:00.702ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1379334908166363263 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
7792024-12-21T08:13:00.702ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13072910765903461688 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
7802024-12-21T08:13:01.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417") failed: Property not found. retry in 994.760561ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7812024-12-21T08:13:01.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f") failed: Property not found. retry in 1.333062041s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7822024-12-21T08:13:01.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a") failed: Property not found. retry in 1.286541254s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7832024-12-21T08:13:01.919ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8722226601379683590 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
7842024-12-21T08:13:01.919ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6806315074612528837 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
7852024-12-21T08:13:02.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_ca884540-0d66-44e4-9133-f0aa43d52417
7862024-12-21T08:13:02.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_3a5d45b5-93a4-4310-9d89-08a86d70030f
7872024-12-21T08:13:02.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_886f4d56-e81e-4132-b564-bc0136a38f4a
7882024-12-21T08:13:02.886ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7892024-12-21T08:13:02.886ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7902024-12-21T08:13:02.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14740562 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47325 req_id = 7ec5fcfa-0df0-4e5a-98ac-539e1e7a970d response_code = 204 uri = /omicron-zones
7912024-12-21T08:13:02.889ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7922024-12-21T08:13:04.080ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7932024-12-21T08:13:04.157ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7942024-12-21T08:13:04.233ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7952024-12-21T08:13:04.233ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7962024-12-21T08:13:04.264ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7972024-12-21T08:13:04.265ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7982024-12-21T08:13:04.265ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7992024-12-21T08:13:04.294ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 3a5d45b5-93a4-4310-9d89-08a86d70030f (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 886f4d56-e81e-4132-b564-bc0136a38f4a (service), filesystem_pool: Some(ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ca884540-0d66-44e4-9133-f0aa43d52417 (service), filesystem_pool: Some(ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5bf73b27-87db-4c53-8497-aae06e06b97f (service), filesystem_pool: Some(ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b59519c2-7497-4a14-a5a7-760ec1593bb8, kind: Service { id: 5bf73b27-87db-4c53-8497-aae06e06b97f }, name: Name("ntp-5bf73b27-87db-4c53-8497-aae06e06b97f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 200])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8002024-12-21T08:13:04.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41864
8012024-12-21T08:13:04.294ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8022024-12-21T08:13:04.294ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8032024-12-21T08:13:04.305ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8042024-12-21T08:13:04.305ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, responder: ... }
8052024-12-21T08:13:04.314ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8062024-12-21T08:13:04.314ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8072024-12-21T08:13:04.324ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8082024-12-21T08:13:04.324ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:177
8092024-12-21T08:13:04.325ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:177
8102024-12-21T08:13:04.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8112024-12-21T08:13:04.336ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8122024-12-21T08:13:04.368ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
8132024-12-21T08:13:04.368ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
8142024-12-21T08:13:04.368ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
8152024-12-21T08:13:04.398ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 161, 200]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
8162024-12-21T08:13:04.398ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
8172024-12-21T08:13:04.398ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
8182024-12-21T08:13:04.398ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
8192024-12-21T08:13:04.399ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8202024-12-21T08:13:04.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8212024-12-21T08:13:04.422ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f file = illumos-utils/src/zone.rs:325
8222024-12-21T08:13:04.440ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f file = illumos-utils/src/zone.rs:363
8232024-12-21T08:13:05.034ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/probe_manager.rs:231 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8242024-12-21T08:13:05.082ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8252024-12-21T08:13:05.082ZINFOSledAgent (ServiceManager): Booting oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8262024-12-21T08:13:05.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 42.77425ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8272024-12-21T08:13:05.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 111.002532ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8282024-12-21T08:13:05.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 272.942443ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8292024-12-21T08:13:05.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 405.120654ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8302024-12-21T08:13:06.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 999.711381ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8312024-12-21T08:13:06.598ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/118e564e-0bce-46c7-b69d-5b3dee81ed48) file = sled-agent/src/nexus.rs:527 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8322024-12-21T08:13:07.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 1.332673612s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8332024-12-21T08:13:08.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 748.66968ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8342024-12-21T08:13:09.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 884.813141ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8352024-12-21T08:13:10.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f") failed: Property not found. retry in 977.349642ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8362024-12-21T08:13:10.705ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1379334908166363263 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8372024-12-21T08:13:10.705ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13072910765903461688 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8382024-12-21T08:13:11.095ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f
8392024-12-21T08:13:11.095ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8402024-12-21T08:13:11.096ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8412024-12-21T08:13:11.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6802104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41864 req_id = 8c9c929b-a83b-40bd-a84c-c19eb64fbccd response_code = 204 uri = /omicron-zones
8422024-12-21T08:13:11.098ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8432024-12-21T08:13:11.129ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8442024-12-21T08:13:11.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37600
8452024-12-21T08:13:11.140ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8462024-12-21T08:13:11.140ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10934 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37600 req_id = 6355eb36-8114-4858-83a2-b6fa2f162c64 response_code = 500 uri = /timesync
8472024-12-21T08:13:11.143ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482024-12-21T08:13:11.258ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492024-12-21T08:13:11.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35467
8502024-12-21T08:13:11.921ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8722226601379683590 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8512024-12-21T08:13:11.922ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6806315074612528837 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8522024-12-21T08:13:12.312ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12655228772323615575 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8532024-12-21T08:13:12.681ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6061475258821510971 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8542024-12-21T08:13:12.890ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12273470292777913047 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
8552024-12-21T08:13:15.269ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8562024-12-21T08:13:15.269ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009963 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 59f7558b-9eb8-4ff8-ac9c-52c5231d3daa response_code = 500 uri = /timesync
8572024-12-21T08:13:15.272ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582024-12-21T08:13:15.458ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592024-12-21T08:13:15.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36124
8602024-12-21T08:13:15.466ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8612024-12-21T08:13:15.467ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8581 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36124 req_id = 8fa189eb-d350-4883-8942-9c2c67b6bee1 response_code = 500 uri = /timesync
8622024-12-21T08:13:15.470ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632024-12-21T08:13:15.629ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642024-12-21T08:13:15.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51491
8652024-12-21T08:13:19.639ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5bf73b27-87db-4c53-8497-aae06e06b97f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8662024-12-21T08:13:19.639ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009018 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51491 req_id = 44e5613a-156e-4b4e-b9b9-8251329d8094 response_code = 500 uri = /timesync
8672024-12-21T08:13:19.642ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682024-12-21T08:13:19.915ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692024-12-21T08:13:19.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63248
8702024-12-21T08:13:19.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23574 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63248 req_id = f29981f9-4697-4d3b-82e2-b2c923ec939c response_code = 200 uri = /timesync
8712024-12-21T08:13:19.943ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1241950281, ip_addr: 74.6.168.73, stratum: 3, ref_time: 1734768798.9159913, correction: -3.846e-5 } file = sled-agent/src/rack_setup/service.rs:743
8722024-12-21T08:13:19.943ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8732024-12-21T08:13:19.974ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 3a5d45b5-93a4-4310-9d89-08a86d70030f (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 886f4d56-e81e-4132-b564-bc0136a38f4a (service), filesystem_pool: Some(ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ca884540-0d66-44e4-9133-f0aa43d52417 (service), filesystem_pool: Some(ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5bf73b27-87db-4c53-8497-aae06e06b97f (service), filesystem_pool: Some(ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b59519c2-7497-4a14-a5a7-760ec1593bb8, kind: Service { id: 5bf73b27-87db-4c53-8497-aae06e06b97f }, name: Name("ntp-5bf73b27-87db-4c53-8497-aae06e06b97f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 200])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: bbf3668f-e09d-4619-ae7e-563e06a816d5 (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2892baae-09b0-498b-b3e3-233c83ccdf17 (service), filesystem_pool: Some(ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } } } }, OmicronZoneConfig { id: 5f857f3f-2205-45c5-846a-9f43810457eb (service), filesystem_pool: Some(ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External } } } }, OmicronZoneConfig { id: 93beefe3-5d46-4372-9a3e-2d65885fb0da (service), filesystem_pool: Some(ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External } } } }, OmicronZoneConfig { id: 36b1fa78-a823-420e-94d7-fba2bec29be0 (service), filesystem_pool: Some(ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8742024-12-21T08:13:19.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37801
8752024-12-21T08:13:19.975ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8762024-12-21T08:13:19.975ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8772024-12-21T08:13:19.984ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8782024-12-21T08:13:19.985ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, responder: ... }
8792024-12-21T08:13:19.994ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8802024-12-21T08:13:19.994ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8812024-12-21T08:13:20.004ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8822024-12-21T08:13:20.004ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8832024-12-21T08:13:20.013ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8842024-12-21T08:13:20.013ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Cockroach }, responder: ... }
8852024-12-21T08:13:20.023ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8862024-12-21T08:13:20.023ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8872024-12-21T08:13:20.032ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8882024-12-21T08:13:20.032ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8892024-12-21T08:13:20.041ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8902024-12-21T08:13:20.041ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8912024-12-21T08:13:20.050ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8922024-12-21T08:13:20.050ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:177
8932024-12-21T08:13:20.050ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:177
8942024-12-21T08:13:20.050ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8952024-12-21T08:13:20.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8962024-12-21T08:13:20.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8972024-12-21T08:13:20.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8982024-12-21T08:13:20.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8992024-12-21T08:13:20.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9002024-12-21T08:13:20.222ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 file = illumos-utils/src/zone.rs:325
9012024-12-21T08:13:20.226ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb file = illumos-utils/src/zone.rs:325
9022024-12-21T08:13:20.230ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da file = illumos-utils/src/zone.rs:325
9032024-12-21T08:13:20.234ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0 file = illumos-utils/src/zone.rs:325
9042024-12-21T08:13:20.238ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5 file = illumos-utils/src/zone.rs:325
9052024-12-21T08:13:20.243ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 file = illumos-utils/src/zone.rs:363
9062024-12-21T08:13:20.248ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb file = illumos-utils/src/zone.rs:363
9072024-12-21T08:13:20.252ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da file = illumos-utils/src/zone.rs:363
9082024-12-21T08:13:20.256ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0 file = illumos-utils/src/zone.rs:363
9092024-12-21T08:13:20.261ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5 file = illumos-utils/src/zone.rs:363
9102024-12-21T08:13:20.798ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 192.847469ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
9112024-12-21T08:13:21.023ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57007
9122024-12-21T08:13:21.023ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57007 req_id = 8c3c667f-4bfc-4767-8da0-817fa055771c response_code = 200 uri = /baseboard
9132024-12-21T08:13:23.298ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='bbf3668f-e09d-4619-ae7e-563e06a816d5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9142024-12-21T08:13:23.298ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9152024-12-21T08:13:23.318ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='93beefe3-5d46-4372-9a3e-2d65885fb0da'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9162024-12-21T08:13:23.318ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9172024-12-21T08:13:23.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 62.071391ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9182024-12-21T08:13:23.448ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5f857f3f-2205-45c5-846a-9f43810457eb'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9192024-12-21T08:13:23.448ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9202024-12-21T08:13:23.453ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2892baae-09b0-498b-b3e3-233c83ccdf17'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9212024-12-21T08:13:23.453ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9222024-12-21T08:13:23.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 69.503369ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9232024-12-21T08:13:23.466ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='36b1fa78-a823-420e-94d7-fba2bec29be0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9242024-12-21T08:13:23.466ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9252024-12-21T08:13:23.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 96.106796ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9262024-12-21T08:13:23.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 62.569844ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9272024-12-21T08:13:23.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 213.649523ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9282024-12-21T08:13:23.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 185.252614ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9292024-12-21T08:13:23.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 31.681676ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9302024-12-21T08:13:23.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 58.18348ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9312024-12-21T08:13:24.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 143.983693ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9322024-12-21T08:13:24.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 51.622351ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9332024-12-21T08:13:24.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 57.735103ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9342024-12-21T08:13:24.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 251.009192ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9352024-12-21T08:13:24.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 291.48147ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9362024-12-21T08:13:24.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 60.663768ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9372024-12-21T08:13:24.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 584.484625ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9382024-12-21T08:13:24.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 191.325613ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9392024-12-21T08:13:24.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 161.319098ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9402024-12-21T08:13:24.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 358.239724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9412024-12-21T08:13:24.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 541.457907ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9422024-12-21T08:13:24.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 247.77264ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9432024-12-21T08:13:24.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 1.017619458s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9442024-12-21T08:13:25.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 1.047534928s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9452024-12-21T08:13:25.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 939.868155ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9462024-12-21T08:13:25.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 402.43725ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9472024-12-21T08:13:25.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 439.501129ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9482024-12-21T08:13:25.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 1.139510105s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9492024-12-21T08:13:25.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 1.230690444s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9502024-12-21T08:13:25.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 785.046748ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9512024-12-21T08:13:26.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 636.017956ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9522024-12-21T08:13:26.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 949.397427ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9532024-12-21T08:13:26.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 500.388768ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9542024-12-21T08:13:26.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 512.542815ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9552024-12-21T08:13:26.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 1.054151708s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9562024-12-21T08:13:26.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 698.595649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9572024-12-21T08:13:27.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 724.764852ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9582024-12-21T08:13:27.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 542.685947ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9592024-12-21T08:13:27.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 974.789576ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9602024-12-21T08:13:27.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 683.960543ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9612024-12-21T08:13:27.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 853.724651ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9622024-12-21T08:13:27.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 1.082461249s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9632024-12-21T08:13:27.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 749.455132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9642024-12-21T08:13:28.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 1.38805402s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9652024-12-21T08:13:28.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 1.184333539s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9662024-12-21T08:13:28.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 1.149350233s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9672024-12-21T08:13:28.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 1.003028179s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9682024-12-21T08:13:28.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 948.282519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9692024-12-21T08:13:29.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 553.002118ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9702024-12-21T08:13:29.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 660.863379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9712024-12-21T08:13:29.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 1.102057986s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9722024-12-21T08:13:29.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 638.951648ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9732024-12-21T08:13:29.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 1.137044494s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9742024-12-21T08:13:30.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 1.082021182s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9752024-12-21T08:13:30.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 1.358267075s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9762024-12-21T08:13:30.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 741.856206ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9772024-12-21T08:13:30.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 738.011887ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9782024-12-21T08:13:30.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 1.398765364s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9792024-12-21T08:13:31.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 1.013703673s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9802024-12-21T08:13:31.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 936.343067ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9812024-12-21T08:13:31.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 581.209564ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9822024-12-21T08:13:31.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 705.264742ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9832024-12-21T08:13:32.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 1.334569585s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9842024-12-21T08:13:32.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 1.48710506s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9852024-12-21T08:13:32.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 1.404057418s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9862024-12-21T08:13:32.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 1.128584013s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9872024-12-21T08:13:32.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 599.190005ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9882024-12-21T08:13:32.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 812.42686ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9892024-12-21T08:13:33.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 799.00189ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9902024-12-21T08:13:33.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17") failed: Property not found. retry in 716.083107ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9912024-12-21T08:13:33.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da") failed: Property not found. retry in 779.710482ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9922024-12-21T08:13:33.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5") failed: Property not found. retry in 1.073436904s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
9932024-12-21T08:13:33.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0") failed: Property not found. retry in 1.134104748s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9942024-12-21T08:13:34.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb") failed: Property not found. retry in 1.170203417s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9952024-12-21T08:13:35.397ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17
9962024-12-21T08:13:35.397ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_5f857f3f-2205-45c5-846a-9f43810457eb
9972024-12-21T08:13:35.397ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_93beefe3-5d46-4372-9a3e-2d65885fb0da
9982024-12-21T08:13:35.397ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_36b1fa78-a823-420e-94d7-fba2bec29be0
9992024-12-21T08:13:35.397ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_bbf3668f-e09d-4619-ae7e-563e06a816d5
10002024-12-21T08:13:35.397ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10012024-12-21T08:13:35.398ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10022024-12-21T08:13:35.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15423833 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37801 req_id = 125eefb8-f3e6-413d-bc2e-6f7f1e3a9b5a response_code = 204 uri = /omicron-zones
10032024-12-21T08:13:35.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53915
10042024-12-21T08:13:35.459ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = 4d3eac86-b95c-4c2f-830a-22e982f9bdd2 response_code = 500 uri = /cockroachdb
10052024-12-21T08:13:35.459ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4d3eac86-b95c-4c2f-830a-22e982f9bdd2", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4d3eac86-b95c-4c2f-830a-22e982f9bdd2" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 71.263746ms
10062024-12-21T08:13:35.559ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = 27bfb676-5309-4757-a73b-f3a7cd1e8142 response_code = 500 uri = /cockroachdb
10072024-12-21T08:13:35.559ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "27bfb676-5309-4757-a73b-f3a7cd1e8142", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "27bfb676-5309-4757-a73b-f3a7cd1e8142" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 75.084218ms
10082024-12-21T08:13:35.663ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = 213a3391-76fc-4a6d-bada-455cf7ceceed response_code = 500 uri = /cockroachdb
10092024-12-21T08:13:35.663ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "213a3391-76fc-4a6d-bada-455cf7ceceed", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "213a3391-76fc-4a6d-bada-455cf7ceceed" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 134.127342ms
10102024-12-21T08:13:35.823ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = a9400e07-e413-4a18-976e-e2ea8621ab8e response_code = 500 uri = /cockroachdb
10112024-12-21T08:13:35.823ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a9400e07-e413-4a18-976e-e2ea8621ab8e", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a9400e07-e413-4a18-976e-e2ea8621ab8e" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 246.737573ms
10122024-12-21T08:13:36.025ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 499.719915ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
10132024-12-21T08:13:36.098ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26893 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = 94fc2f94-a820-4478-940b-a73988adf8f1 response_code = 500 uri = /cockroachdb
10142024-12-21T08:13:36.098ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "94fc2f94-a820-4478-940b-a73988adf8f1", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "94fc2f94-a820-4478-940b-a73988adf8f1" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 222.572808ms
10152024-12-21T08:13:36.347ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24968 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = f69badd7-332e-4f75-a043-d6bcf4a1e193 response_code = 500 uri = /cockroachdb
10162024-12-21T08:13:36.347ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f69badd7-332e-4f75-a043-d6bcf4a1e193", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f69badd7-332e-4f75-a043-d6bcf4a1e193" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 187.790764ms
10172024-12-21T08:13:36.583ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25368 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = 7b1dc788-8b40-40c8-a26d-3e387ce95821 response_code = 500 uri = /cockroachdb
10182024-12-21T08:13:36.583ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7b1dc788-8b40-40c8-a26d-3e387ce95821", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7b1dc788-8b40-40c8-a26d-3e387ce95821" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 329.411488ms
10192024-12-21T08:13:36.938ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = f6921e98-6e21-4df4-abc6-509840cd1fc0 response_code = 500 uri = /cockroachdb
10202024-12-21T08:13:36.939ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f6921e98-6e21-4df4-abc6-509840cd1fc0", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f6921e98-6e21-4df4-abc6-509840cd1fc0" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 476.518273ms
10212024-12-21T08:13:37.445ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2892baae-09b0-498b-b3e3-233c83ccdf17 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29056 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = 4306d25f-7e36-410d-8de2-11868f870a09 response_code = 500 uri = /cockroachdb
10222024-12-21T08:13:37.445ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4306d25f-7e36-410d-8de2-11868f870a09", "content-length": "124", "date": "Sat, 21 Dec 2024 08:13:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4306d25f-7e36-410d-8de2-11868f870a09" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 548.354256ms
10232024-12-21T08:13:38.029ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3758
10242024-12-21T08:13:48.258ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
10252024-12-21T08:13:53.046ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
10262024-12-21T08:13:53.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15051611 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53915 req_id = efff482d-43ea-489c-8c1d-00ddbad9e320 response_code = 204 uri = /cockroachdb
10272024-12-21T08:13:53.052ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39199
10282024-12-21T08:13:53.053ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 543 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39199 req_id = 452e2958-9e26-41f1-acda-7852cbfb71cc response_code = 200 uri = /baseboard
10292024-12-21T08:13:53.059ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.446171482s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
10302024-12-21T08:13:53.102ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 3a5d45b5-93a4-4310-9d89-08a86d70030f (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 886f4d56-e81e-4132-b564-bc0136a38f4a (service), filesystem_pool: Some(ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ca884540-0d66-44e4-9133-f0aa43d52417 (service), filesystem_pool: Some(ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5bf73b27-87db-4c53-8497-aae06e06b97f (service), filesystem_pool: Some(ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b59519c2-7497-4a14-a5a7-760ec1593bb8, kind: Service { id: 5bf73b27-87db-4c53-8497-aae06e06b97f }, name: Name("ntp-5bf73b27-87db-4c53-8497-aae06e06b97f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 200])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: bbf3668f-e09d-4619-ae7e-563e06a816d5 (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2892baae-09b0-498b-b3e3-233c83ccdf17 (service), filesystem_pool: Some(ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } } } }, OmicronZoneConfig { id: 5f857f3f-2205-45c5-846a-9f43810457eb (service), filesystem_pool: Some(ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External } } } }, OmicronZoneConfig { id: 93beefe3-5d46-4372-9a3e-2d65885fb0da (service), filesystem_pool: Some(ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External } } } }, OmicronZoneConfig { id: 36b1fa78-a823-420e-94d7-fba2bec29be0 (service), filesystem_pool: Some(ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External } } } }, OmicronZoneConfig { id: f32db93d-bd49-40af-b49e-21286ae1d662 (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 67643b43-461d-4a9a-b2c9-50310796834b (service), filesystem_pool: Some(ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba (service), filesystem_pool: Some(ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 (service), filesystem_pool: Some(ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 (service), filesystem_pool: Some(ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 86765e8c-dc79-4c52-9d92-7a5af48fd55f (service), filesystem_pool: Some(ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: db2b8c5f-7cd9-44fc-8af7-5086ba22c155 (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9 (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2 (service), filesystem_pool: Some(ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 83f27e44-8c25-498a-bc4d-a79778998f67 (service), filesystem_pool: Some(ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: f756aeba-d53c-41e8-bcaa-fe202743fee6 (service), filesystem_pool: Some(ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f (service), filesystem_pool: Some(ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External } } } }, OmicronZoneConfig { id: 3f24b54a-b77a-46f2-bf47-e4bc27d280f0 (service), filesystem_pool: Some(ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0b706ed5-9c57-481f-a8ab-285b29250bed (service), filesystem_pool: Some(ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External } } } }, OmicronZoneConfig { id: b84f5db9-03af-4a33-8856-01cb4fcb8a8c (service), filesystem_pool: Some(ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External } } } }, OmicronZoneConfig { id: 591e4027-d937-4f19-bb67-082d5877b915 (service), filesystem_pool: Some(ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External } } } }, OmicronZoneConfig { id: 46aab58b-6e8e-4e0e-989a-65630375e33e (service), filesystem_pool: Some(ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External } } } }, OmicronZoneConfig { id: b06f2be2-d169-4e82-b379-936275958456 (service), filesystem_pool: Some(ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External } } } }, OmicronZoneConfig { id: eb06ae20-0034-433f-9a1f-1af56f2ca574 (service), filesystem_pool: Some(ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10312024-12-21T08:13:53.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44414
10322024-12-21T08:13:53.105ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10332024-12-21T08:13:53.105ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10342024-12-21T08:13:53.126ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10352024-12-21T08:13:53.126ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: InternalDns }, responder: ... }
10362024-12-21T08:13:53.141ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10372024-12-21T08:13:53.141ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10382024-12-21T08:13:53.155ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10392024-12-21T08:13:53.155ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10402024-12-21T08:13:53.171ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10412024-12-21T08:13:53.171ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Cockroach }, responder: ... }
10422024-12-21T08:13:53.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10432024-12-21T08:13:53.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10442024-12-21T08:13:53.199ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10452024-12-21T08:13:53.199ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10462024-12-21T08:13:53.212ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10472024-12-21T08:13:53.212ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10482024-12-21T08:13:53.225ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10492024-12-21T08:13:53.225ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10502024-12-21T08:13:53.237ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10512024-12-21T08:13:53.237ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10522024-12-21T08:13:53.251ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10532024-12-21T08:13:53.251ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10542024-12-21T08:13:53.265ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10552024-12-21T08:13:53.265ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10562024-12-21T08:13:53.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10572024-12-21T08:13:53.280ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, kind: Crucible }, responder: ... }
10582024-12-21T08:13:53.294ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10592024-12-21T08:13:53.294ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, kind: Crucible }, responder: ... }
10602024-12-21T08:13:53.308ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10612024-12-21T08:13:53.308ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, kind: Crucible }, responder: ... }
10622024-12-21T08:13:53.321ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10632024-12-21T08:13:53.321ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, kind: Crucible }, responder: ... }
10642024-12-21T08:13:53.337ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10652024-12-21T08:13:53.337ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, kind: Crucible }, responder: ... }
10662024-12-21T08:13:53.351ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10672024-12-21T08:13:53.351ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, kind: Crucible }, responder: ... }
10682024-12-21T08:13:53.365ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10692024-12-21T08:13:53.365ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, kind: Crucible }, responder: ... }
10702024-12-21T08:13:53.380ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10712024-12-21T08:13:53.380ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, kind: Crucible }, responder: ... }
10722024-12-21T08:13:53.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10732024-12-21T08:13:53.396ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:177
10742024-12-21T08:13:53.396ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:177
10752024-12-21T08:13:53.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10762024-12-21T08:13:53.552ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10772024-12-21T08:13:53.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10782024-12-21T08:13:53.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10792024-12-21T08:13:53.582ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10802024-12-21T08:13:53.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10812024-12-21T08:13:53.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10822024-12-21T08:13:53.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10832024-12-21T08:13:53.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10842024-12-21T08:13:53.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10852024-12-21T08:13:53.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862024-12-21T08:13:53.862ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10872024-12-21T08:13:53.863ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10882024-12-21T08:13:53.864ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10892024-12-21T08:13:53.878ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10902024-12-21T08:13:53.879ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10912024-12-21T08:13:53.879ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10922024-12-21T08:13:53.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10932024-12-21T08:13:53.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10942024-12-21T08:13:53.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952024-12-21T08:13:53.914ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67 file = illumos-utils/src/zone.rs:325
10962024-12-21T08:13:53.920ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6 file = illumos-utils/src/zone.rs:325
10972024-12-21T08:13:53.926ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c file = illumos-utils/src/zone.rs:325
10982024-12-21T08:13:53.932ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9 file = illumos-utils/src/zone.rs:325
10992024-12-21T08:13:53.937ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed file = illumos-utils/src/zone.rs:325
11002024-12-21T08:13:53.942ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2 file = illumos-utils/src/zone.rs:325
11012024-12-21T08:13:53.947ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915 file = illumos-utils/src/zone.rs:325
11022024-12-21T08:13:53.953ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f file = illumos-utils/src/zone.rs:325
11032024-12-21T08:13:54.083ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67 file = illumos-utils/src/zone.rs:363
11042024-12-21T08:13:54.088ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6 file = illumos-utils/src/zone.rs:363
11052024-12-21T08:13:54.094ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c file = illumos-utils/src/zone.rs:363
11062024-12-21T08:13:54.099ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9 file = illumos-utils/src/zone.rs:363
11072024-12-21T08:13:54.104ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed file = illumos-utils/src/zone.rs:363
11082024-12-21T08:13:54.109ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2 file = illumos-utils/src/zone.rs:363
11092024-12-21T08:13:54.114ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915 file = illumos-utils/src/zone.rs:363
11102024-12-21T08:13:54.120ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f file = illumos-utils/src/zone.rs:363
11112024-12-21T08:13:54.125ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574 file = illumos-utils/src/zone.rs:325
11122024-12-21T08:13:54.132ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f file = illumos-utils/src/zone.rs:325
11132024-12-21T08:13:54.138ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0 file = illumos-utils/src/zone.rs:325
11142024-12-21T08:13:54.144ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e file = illumos-utils/src/zone.rs:325
11152024-12-21T08:13:54.150ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155 file = illumos-utils/src/zone.rs:325
11162024-12-21T08:13:54.157ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b06f2be2-d169-4e82-b379-936275958456 file = illumos-utils/src/zone.rs:325
11172024-12-21T08:13:54.222ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11182024-12-21T08:13:54.223ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574 file = illumos-utils/src/zone.rs:363
11192024-12-21T08:13:54.235ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f file = illumos-utils/src/zone.rs:363
11202024-12-21T08:13:54.247ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0 file = illumos-utils/src/zone.rs:363
11212024-12-21T08:13:54.260ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e file = illumos-utils/src/zone.rs:363
11222024-12-21T08:13:54.269ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155 file = illumos-utils/src/zone.rs:363
11232024-12-21T08:13:54.278ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b06f2be2-d169-4e82-b379-936275958456 file = illumos-utils/src/zone.rs:363
11242024-12-21T08:13:54.350ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11252024-12-21T08:13:54.422ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11262024-12-21T08:13:54.532ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11272024-12-21T08:13:54.608ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11282024-12-21T08:13:54.611ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11292024-12-21T08:13:54.611ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11302024-12-21T08:13:54.670ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 214, 36]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11312024-12-21T08:13:54.672ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11322024-12-21T08:13:54.674ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11332024-12-21T08:13:54.674ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11342024-12-21T08:13:54.729ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 165, 104]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11352024-12-21T08:13:54.729ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11362024-12-21T08:13:54.730ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11372024-12-21T08:13:54.731ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11382024-12-21T08:13:54.785ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 151, 129]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11392024-12-21T08:13:54.785ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11402024-12-21T08:13:54.786ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11412024-12-21T08:13:54.786ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11422024-12-21T08:13:54.840ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 153, 237]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11432024-12-21T08:13:54.840ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11442024-12-21T08:13:54.841ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11452024-12-21T08:13:54.841ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11462024-12-21T08:13:54.894ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 197, 252]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11472024-12-21T08:13:54.894ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11482024-12-21T08:13:54.894ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11492024-12-21T08:13:54.894ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11502024-12-21T08:13:54.895ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11512024-12-21T08:13:54.895ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11522024-12-21T08:13:54.895ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11532024-12-21T08:13:54.895ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11542024-12-21T08:13:54.895ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11552024-12-21T08:13:54.895ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11562024-12-21T08:13:54.895ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11572024-12-21T08:13:54.897ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11582024-12-21T08:13:54.899ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11592024-12-21T08:13:54.899ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11602024-12-21T08:13:54.899ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11612024-12-21T08:13:54.901ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11622024-12-21T08:13:54.901ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11632024-12-21T08:13:54.901ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11642024-12-21T08:13:54.902ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11652024-12-21T08:13:54.904ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11662024-12-21T08:13:55.145ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11672024-12-21T08:13:55.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11682024-12-21T08:13:55.191ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 file = illumos-utils/src/zone.rs:325
11692024-12-21T08:13:55.201ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662 file = illumos-utils/src/zone.rs:325
11702024-12-21T08:13:55.213ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b file = illumos-utils/src/zone.rs:325
11712024-12-21T08:13:55.366ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47 file = illumos-utils/src/zone.rs:325
11722024-12-21T08:13:55.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 file = illumos-utils/src/zone.rs:363
11732024-12-21T08:13:55.440ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662 file = illumos-utils/src/zone.rs:363
11742024-12-21T08:13:55.472ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b file = illumos-utils/src/zone.rs:363
11752024-12-21T08:13:55.505ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba file = illumos-utils/src/zone.rs:325
11762024-12-21T08:13:55.533ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47 file = illumos-utils/src/zone.rs:363
11772024-12-21T08:13:55.581ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba file = illumos-utils/src/zone.rs:363
11782024-12-21T08:14:00.220ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11792024-12-21T08:14:00.220ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11802024-12-21T08:14:00.245ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
11812024-12-21T08:14:00.253ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
11822024-12-21T08:14:00.332ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11832024-12-21T08:14:00.346ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
11842024-12-21T08:14:00.353ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='48c55414-f4bf-4e39-9c4a-03b5e24b37fd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11852024-12-21T08:14:00.354ZINFOSledAgent (ServiceManager): Booting oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
11862024-12-21T08:14:00.366ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b06f2be2-d169-4e82-b379-936275958456: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='628c8f31-7bed-46d8-bf94-cb908807c398'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11872024-12-21T08:14:00.366ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a0ee6a37-4e9b-470d-ad7c-0de4a8c4f97e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882024-12-21T08:14:00.366ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d833c482-0e79-4963-a45e-83fa8b9a7979'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892024-12-21T08:14:00.367ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5c782891-c1e8-4191-bfea-a3d07d39b468/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f70a587c-b93d-429e-b5a5-3f05c0f7bf0e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902024-12-21T08:14:00.367ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6abcdcb0-54e9-4692-9684-b09224a2df95'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11912024-12-21T08:14:00.367ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='33932aa4-f5c6-4b44-836e-b10eae75bb52'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11922024-12-21T08:14:00.367ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5e127270-ae6a-4a55-900b-4894ec033839'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932024-12-21T08:14:00.367ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b06f2be2-d169-4e82-b379-936275958456 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
11942024-12-21T08:14:00.374ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
11952024-12-21T08:14:00.380ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
11962024-12-21T08:14:00.388ZINFOSledAgent (ServiceManager): Booting oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
11972024-12-21T08:14:00.401ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
11982024-12-21T08:14:00.408ZINFOSledAgent (ServiceManager): Booting oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
11992024-12-21T08:14:00.414ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
12002024-12-21T08:14:01.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 52.949384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
12012024-12-21T08:14:01.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 49.818493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
12022024-12-21T08:14:04.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 27.600241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
12032024-12-21T08:14:04.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 38.598125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
12042024-12-21T08:14:04.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 27.204392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
12052024-12-21T08:14:04.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 29.332472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
12062024-12-21T08:14:04.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 64.678678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
12072024-12-21T08:14:04.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 36.294238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
12082024-12-21T08:14:04.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 60.926485ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
12092024-12-21T08:14:04.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 71.966722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
12102024-12-21T08:14:04.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 72.157255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
12112024-12-21T08:14:04.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 137.162205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
12122024-12-21T08:14:04.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 87.275138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
12132024-12-21T08:14:04.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 88.126532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
12142024-12-21T08:14:04.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 139.876736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
12152024-12-21T08:14:04.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 123.005761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
12162024-12-21T08:14:04.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 52.457061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
12172024-12-21T08:14:04.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 141.113997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
12182024-12-21T08:14:04.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 122.0817ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
12192024-12-21T08:14:04.849ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='86765e8c-dc79-4c52-9d92-7a5af48fd55f'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12202024-12-21T08:14:04.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 86.24785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
12212024-12-21T08:14:04.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 123.499027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
12222024-12-21T08:14:04.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 65.437118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
12232024-12-21T08:14:04.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 274.812615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
12242024-12-21T08:14:04.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 201.616954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
12252024-12-21T08:14:04.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 206.045842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
12262024-12-21T08:14:04.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 156.896774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
12272024-12-21T08:14:04.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 177.987136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
12282024-12-21T08:14:04.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 121.152377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
12292024-12-21T08:14:04.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 260.640205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
12302024-12-21T08:14:05.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 220.271665ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
12312024-12-21T08:14:05.004ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
12322024-12-21T08:14:05.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 249.579702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
12332024-12-21T08:14:05.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 280.247885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
12342024-12-21T08:14:05.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 190.104602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
12352024-12-21T08:14:05.052ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362024-12-21T08:14:05.052ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
12372024-12-21T08:14:05.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 406.837693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
12382024-12-21T08:14:05.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 323.842627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
12392024-12-21T08:14:05.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 350.772939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
12402024-12-21T08:14:05.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 344.513514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
12412024-12-21T08:14:05.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 475.474243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
12422024-12-21T08:14:05.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 390.97115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
12432024-12-21T08:14:05.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 484.538371ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
12442024-12-21T08:14:05.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 43.298205ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
12452024-12-21T08:14:05.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 567.586057ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
12462024-12-21T08:14:05.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 53.92305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
12472024-12-21T08:14:05.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 555.875702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
12482024-12-21T08:14:05.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 215.73056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
12492024-12-21T08:14:05.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 116.413114ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
12502024-12-21T08:14:05.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 401.589964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
12512024-12-21T08:14:05.333ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12522024-12-21T08:14:05.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 126.3914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
12532024-12-21T08:14:05.346ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
12542024-12-21T08:14:05.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 228.789952ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
12552024-12-21T08:14:05.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 973.371423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
12562024-12-21T08:14:05.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 285.550783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
12572024-12-21T08:14:05.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 720.75646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
12582024-12-21T08:14:05.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 1.078136116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
12592024-12-21T08:14:05.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 913.739371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
12602024-12-21T08:14:05.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 717.75785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
12612024-12-21T08:14:05.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 954.110899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
12622024-12-21T08:14:05.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.024796418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
12632024-12-21T08:14:05.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 247.657044ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
12642024-12-21T08:14:05.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.127093436s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
12652024-12-21T08:14:05.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.114846599s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
12662024-12-21T08:14:05.761ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='87dc3eb7-03cf-4048-b02c-5f9331c06d7f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12672024-12-21T08:14:05.762ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
12682024-12-21T08:14:05.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 267.419109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
12692024-12-21T08:14:05.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 62.785911ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
12702024-12-21T08:14:05.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 743.500861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
12712024-12-21T08:14:05.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 547.747632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
12722024-12-21T08:14:05.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 56.099388ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
12732024-12-21T08:14:05.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 728.505053ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
12742024-12-21T08:14:05.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 123.895038ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
12752024-12-21T08:14:06.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 860.902281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
12762024-12-21T08:14:06.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 257.203004ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
12772024-12-21T08:14:06.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 52.76451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
12782024-12-21T08:14:06.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 83.755837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
12792024-12-21T08:14:06.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 1.384276788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
12802024-12-21T08:14:06.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 238.917028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
12812024-12-21T08:14:06.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 988.035474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
12822024-12-21T08:14:06.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 513.892525ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
12832024-12-21T08:14:06.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 803.092861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
12842024-12-21T08:14:06.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 1.032139234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
12852024-12-21T08:14:06.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 530.074164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
12862024-12-21T08:14:06.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 422.048994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
12872024-12-21T08:14:06.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.471268493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
12882024-12-21T08:14:06.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.207528738s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
12892024-12-21T08:14:06.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 784.17423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
12902024-12-21T08:14:06.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 522.034519ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
12912024-12-21T08:14:06.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.364130422s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
12922024-12-21T08:14:06.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.24529707s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
12932024-12-21T08:14:06.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 841.959158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
12942024-12-21T08:14:06.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 1.461436152s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
12952024-12-21T08:14:06.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 502.783517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
12962024-12-21T08:14:06.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 418.72829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
12972024-12-21T08:14:07.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.064263175s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
12982024-12-21T08:14:07.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 768.102869ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
12992024-12-21T08:14:07.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 942.523743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
13002024-12-21T08:14:07.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.441568941s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
13012024-12-21T08:14:07.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 893.124573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
13022024-12-21T08:14:07.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 762.20128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
13032024-12-21T08:14:07.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 596.304828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
13042024-12-21T08:14:07.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 960.60457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
13052024-12-21T08:14:07.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 534.13027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
13062024-12-21T08:14:07.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.328078737s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
13072024-12-21T08:14:07.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.230209998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
13082024-12-21T08:14:07.880ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092024-12-21T08:14:07.880ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13102024-12-21T08:14:07.880ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
13112024-12-21T08:14:07.888ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13122024-12-21T08:14:07.888ZINFOSledAgent (ServiceManager): Booting oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13132024-12-21T08:14:07.896ZINFOSledAgent (ServiceManager): Booting oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
13142024-12-21T08:14:08.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 1.255252754s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
13152024-12-21T08:14:08.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 699.739592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
13162024-12-21T08:14:08.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 637.138218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
13172024-12-21T08:14:08.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 899.225354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
13182024-12-21T08:14:08.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.31452434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
13192024-12-21T08:14:08.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 30.070216ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13202024-12-21T08:14:08.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 750.061988ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
13212024-12-21T08:14:08.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 93.907278ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13222024-12-21T08:14:08.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 760.706383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
13232024-12-21T08:14:08.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 1.279176165s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
13242024-12-21T08:14:08.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 1.06630375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
13252024-12-21T08:14:08.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 189.534051ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13262024-12-21T08:14:08.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 69.434688ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
13272024-12-21T08:14:08.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 66.728319ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
13282024-12-21T08:14:08.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 857.8708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
13292024-12-21T08:14:08.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 61.559245ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
13302024-12-21T08:14:08.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 143.515954ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
13312024-12-21T08:14:08.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 821.542659ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
13322024-12-21T08:14:08.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 297.137205ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
13332024-12-21T08:14:08.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 310.490604ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13342024-12-21T08:14:08.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 891.068866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
13352024-12-21T08:14:08.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 170.252584ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
13362024-12-21T08:14:08.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 316.557039ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
13372024-12-21T08:14:08.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 1.438747349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
13382024-12-21T08:14:08.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 285.502654ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
13392024-12-21T08:14:08.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 878.722627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
13402024-12-21T08:14:08.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.165518566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
13412024-12-21T08:14:08.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 1.066434562s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13422024-12-21T08:14:08.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 813.469271ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
13432024-12-21T08:14:08.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 798.231497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
13442024-12-21T08:14:09.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 984.556805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
13452024-12-21T08:14:09.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 1.047630883s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
13462024-12-21T08:14:09.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 955.688419ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
13472024-12-21T08:14:09.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.276471408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
13482024-12-21T08:14:09.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 644.456193ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
13492024-12-21T08:14:09.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 896.455943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
13502024-12-21T08:14:09.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 1.498138095s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
13512024-12-21T08:14:09.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 1.046606686s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
13522024-12-21T08:14:09.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 988.856968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
13532024-12-21T08:14:09.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 713.283764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
13542024-12-21T08:14:09.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.290122324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
13552024-12-21T08:14:09.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 1.133578649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
13562024-12-21T08:14:09.636ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.784862722s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
13572024-12-21T08:14:09.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 502.033745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
13582024-12-21T08:14:09.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.177824636s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
13592024-12-21T08:14:09.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 959.316644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
13602024-12-21T08:14:09.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 687.337538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
13612024-12-21T08:14:09.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 1.117592588s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13622024-12-21T08:14:09.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.405884697s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
13632024-12-21T08:14:09.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.234815163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
13642024-12-21T08:14:10.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 1.343704009s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
13652024-12-21T08:14:10.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.359050357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
13662024-12-21T08:14:10.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 1.23461726s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
13672024-12-21T08:14:10.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 588.59994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
13682024-12-21T08:14:10.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 1.255211971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
13692024-12-21T08:14:10.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.488777363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
13702024-12-21T08:14:10.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 1.028786676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
13712024-12-21T08:14:10.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 951.828334ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
13722024-12-21T08:14:10.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 918.498653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
13732024-12-21T08:14:10.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 711.718539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
13742024-12-21T08:14:10.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 1.137901691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
13752024-12-21T08:14:10.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 537.457244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
13762024-12-21T08:14:10.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 1.094802397s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
13772024-12-21T08:14:10.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 630.35554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
13782024-12-21T08:14:10.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 1.46968323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
13792024-12-21T08:14:10.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 846.742989ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
13802024-12-21T08:14:10.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 830.246672ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13812024-12-21T08:14:11.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 793.351009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
13822024-12-21T08:14:11.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.297974235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
13832024-12-21T08:14:11.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 892.917293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
13842024-12-21T08:14:11.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 1.05012483s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
13852024-12-21T08:14:11.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 734.758122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
13862024-12-21T08:14:11.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 1.400887357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
13872024-12-21T08:14:11.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 1.329950226s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
13882024-12-21T08:14:11.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 927.131897ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
13892024-12-21T08:14:11.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 890.860712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
13902024-12-21T08:14:11.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.134675566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
13912024-12-21T08:14:11.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.054141502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
13922024-12-21T08:14:11.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 1.468795869s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
13932024-12-21T08:14:11.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.29659591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
13942024-12-21T08:14:11.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 744.80944ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
13952024-12-21T08:14:11.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 933.258598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
13962024-12-21T08:14:11.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 652.767912ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
13972024-12-21T08:14:11.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 1.134318554s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
13982024-12-21T08:14:12.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 644.181229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
13992024-12-21T08:14:12.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 578.270582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
14002024-12-21T08:14:12.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 880.054482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
14012024-12-21T08:14:12.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 1.024248991s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
14022024-12-21T08:14:12.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.198503916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
14032024-12-21T08:14:12.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 598.951595ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
14042024-12-21T08:14:12.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 798.361054ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
14052024-12-21T08:14:12.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 1.397747305s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
14062024-12-21T08:14:12.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 664.500659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
14072024-12-21T08:14:12.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.048877158s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
14082024-12-21T08:14:12.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.397742747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
14092024-12-21T08:14:12.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.150106313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
14102024-12-21T08:14:12.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 643.095824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
14112024-12-21T08:14:12.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 762.088327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
14122024-12-21T08:14:12.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 724.52736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
14132024-12-21T08:14:12.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 800.32581ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
14142024-12-21T08:14:12.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.360955053s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
14152024-12-21T08:14:12.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 1.239910471s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
14162024-12-21T08:14:12.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 1.01476852s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
14172024-12-21T08:14:12.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.186317643s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
14182024-12-21T08:14:13.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 541.835662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
14192024-12-21T08:14:13.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 940.702104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
14202024-12-21T08:14:13.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 1.452350437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
14212024-12-21T08:14:13.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.365854907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
14222024-12-21T08:14:13.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 1.222588491s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
14232024-12-21T08:14:13.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.191580659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
14242024-12-21T08:14:13.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.13441559s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
14252024-12-21T08:14:13.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 941.352101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
14262024-12-21T08:14:13.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 714.234134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
14272024-12-21T08:14:13.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 1.261715799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
14282024-12-21T08:14:13.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 548.256315ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
14292024-12-21T08:14:13.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.425445711s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
14302024-12-21T08:14:13.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.225245418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
14312024-12-21T08:14:13.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 723.013613ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
14322024-12-21T08:14:14.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 746.345826ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
14332024-12-21T08:14:14.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 1.365240686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
14342024-12-21T08:14:14.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 670.794302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
14352024-12-21T08:14:14.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 1.050031652s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
14362024-12-21T08:14:14.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 985.017218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
14372024-12-21T08:14:14.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 897.607603ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
14382024-12-21T08:14:14.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.328416273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
14392024-12-21T08:14:14.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 741.225216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
14402024-12-21T08:14:14.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 625.612065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
14412024-12-21T08:14:14.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 890.259146ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
14422024-12-21T08:14:14.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.444553377s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
14432024-12-21T08:14:14.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.058418237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
14442024-12-21T08:14:14.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 645.611543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
14452024-12-21T08:14:14.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 1.338992742s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
14462024-12-21T08:14:14.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 952.520562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
14472024-12-21T08:14:14.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 555.502577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
14482024-12-21T08:14:14.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 957.009351ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
14492024-12-21T08:14:14.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 857.831403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
14502024-12-21T08:14:15.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 591.72918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
14512024-12-21T08:14:15.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 812.821602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
14522024-12-21T08:14:15.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 804.690528ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
14532024-12-21T08:14:15.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 901.840941ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
14542024-12-21T08:14:15.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 1.419250081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
14552024-12-21T08:14:15.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.131825276s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
14562024-12-21T08:14:15.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 969.914066ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
14572024-12-21T08:14:15.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 906.892336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
14582024-12-21T08:14:15.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.150643388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
14592024-12-21T08:14:15.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 752.793029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
14602024-12-21T08:14:15.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 945.515088ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
14612024-12-21T08:14:15.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.435903016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
14622024-12-21T08:14:15.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 729.33593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
14632024-12-21T08:14:15.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 688.209492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
14642024-12-21T08:14:15.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.046235953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
14652024-12-21T08:14:15.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 1.165087033s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
14662024-12-21T08:14:15.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 888.904152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
14672024-12-21T08:14:15.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 1.054682214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
14682024-12-21T08:14:15.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.089592724s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
14692024-12-21T08:14:16.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 548.234388ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
14702024-12-21T08:14:16.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 846.243838ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
14712024-12-21T08:14:16.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 665.518071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
14722024-12-21T08:14:16.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 828.134975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
14732024-12-21T08:14:16.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 1.398817883s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
14742024-12-21T08:14:16.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 616.049233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
14752024-12-21T08:14:16.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 628.583521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
14762024-12-21T08:14:16.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.139835675s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
14772024-12-21T08:14:16.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.464592019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
14782024-12-21T08:14:16.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 1.484857136s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
14792024-12-21T08:14:16.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 800.131295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
14802024-12-21T08:14:16.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 687.717986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
14812024-12-21T08:14:16.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 990.35639ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
14822024-12-21T08:14:16.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 587.579664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
14832024-12-21T08:14:16.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.134927057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
14842024-12-21T08:14:16.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 663.92776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
14852024-12-21T08:14:16.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 971.952808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
14862024-12-21T08:14:16.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 1.14268896s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
14872024-12-21T08:14:16.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 860.947145ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
14882024-12-21T08:14:16.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 655.202661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
14892024-12-21T08:14:16.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.018213531s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
14902024-12-21T08:14:16.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 1.169164663s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
14912024-12-21T08:14:17.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.40116461s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
14922024-12-21T08:14:17.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.012302393s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
14932024-12-21T08:14:17.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 1.066080274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
14942024-12-21T08:14:17.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 1.118893572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
14952024-12-21T08:14:17.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 523.762717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
14962024-12-21T08:14:17.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.382244947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
14972024-12-21T08:14:17.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 529.001471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
14982024-12-21T08:14:17.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 1.400373033s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
14992024-12-21T08:14:17.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 534.789868ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
15002024-12-21T08:14:17.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 938.276879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
15012024-12-21T08:14:17.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 950.653626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
15022024-12-21T08:14:17.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 568.844165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
15032024-12-21T08:14:17.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.243857616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
15042024-12-21T08:14:17.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.067190335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
15052024-12-21T08:14:17.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 970.461573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
15062024-12-21T08:14:17.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 778.376209ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
15072024-12-21T08:14:17.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.4581706s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
15082024-12-21T08:14:18.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.363853006s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
15092024-12-21T08:14:18.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 638.816454ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
15102024-12-21T08:14:18.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 521.736011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
15112024-12-21T08:14:18.082ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15122024-12-21T08:14:18.082ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15132024-12-21T08:14:18.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 1.419045568s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
15142024-12-21T08:14:18.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 649.944459ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
15152024-12-21T08:14:18.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 1.283416919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
15162024-12-21T08:14:18.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 51.356922ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15172024-12-21T08:14:18.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 972.937338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
15182024-12-21T08:14:18.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 599.512737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
15192024-12-21T08:14:18.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.495599923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
15202024-12-21T08:14:18.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 143.424432ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15212024-12-21T08:14:18.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 875.811406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
15222024-12-21T08:14:18.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 241.389912ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15232024-12-21T08:14:18.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.222883145s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
15242024-12-21T08:14:18.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 1.387283226s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
15252024-12-21T08:14:18.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 925.585206ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
15262024-12-21T08:14:18.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 1.245662787s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
15272024-12-21T08:14:18.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 613.642622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
15282024-12-21T08:14:18.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 365.116243ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15292024-12-21T08:14:18.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.149693058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
15302024-12-21T08:14:18.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 868.16474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
15312024-12-21T08:14:18.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.495027101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
15322024-12-21T08:14:19.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 1.458887064s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
15332024-12-21T08:14:19.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 558.433122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
15342024-12-21T08:14:19.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 803.946245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
15352024-12-21T08:14:19.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 853.526167ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15362024-12-21T08:14:19.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 1.076755512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
15372024-12-21T08:14:19.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.196759759s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
15382024-12-21T08:14:19.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.191783632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
15392024-12-21T08:14:19.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 714.924054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
15402024-12-21T08:14:19.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 1.393444228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
15412024-12-21T08:14:19.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 1.243821592s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
15422024-12-21T08:14:19.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 1.314756388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
15432024-12-21T08:14:19.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 766.791732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
15442024-12-21T08:14:19.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 1.185022729s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
15452024-12-21T08:14:19.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.194416405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
15462024-12-21T08:14:19.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.372876109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
15472024-12-21T08:14:19.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 998.834352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
15482024-12-21T08:14:19.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 662.635641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
15492024-12-21T08:14:20.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 1.025793881s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
15502024-12-21T08:14:20.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.334007907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
15512024-12-21T08:14:20.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.478083573s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15522024-12-21T08:14:20.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 611.236093ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
15532024-12-21T08:14:20.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 802.554003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
15542024-12-21T08:14:20.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 915.968271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
15552024-12-21T08:14:20.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 911.322492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
15562024-12-21T08:14:20.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 731.812234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
15572024-12-21T08:14:20.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 716.458394ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
15582024-12-21T08:14:20.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.117207516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
15592024-12-21T08:14:20.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 762.140167ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
15602024-12-21T08:14:20.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.079908686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
15612024-12-21T08:14:20.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 727.882091ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
15622024-12-21T08:14:20.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 615.835613ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
15632024-12-21T08:14:20.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f") failed: Property not found. retry in 1.276776262s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
15642024-12-21T08:14:20.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 1.169317633s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
15652024-12-21T08:14:20.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 674.91491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
15662024-12-21T08:14:20.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 1.245140756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
15672024-12-21T08:14:20.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.415247201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
15682024-12-21T08:14:21.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9") failed: Property not found. retry in 1.319830081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
15692024-12-21T08:14:21.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 1.175917137s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
15702024-12-21T08:14:21.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 689.969417ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
15712024-12-21T08:14:21.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 1.291613593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
15722024-12-21T08:14:21.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 673.281694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
15732024-12-21T08:14:21.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 1.194777539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
15742024-12-21T08:14:21.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 722.811378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
15752024-12-21T08:14:21.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.471420492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
15762024-12-21T08:14:21.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 916.308076ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
15772024-12-21T08:14:21.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 812.628329ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
15782024-12-21T08:14:21.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 561.125602ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
15792024-12-21T08:14:21.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 638.45042ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15802024-12-21T08:14:21.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.402967583s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
15812024-12-21T08:14:21.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 1.093695083s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
15822024-12-21T08:14:21.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 1.493979434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
15832024-12-21T08:14:21.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 932.719703ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
15842024-12-21T08:14:21.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 1.268995895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
15852024-12-21T08:14:22.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 1.162382774s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
15862024-12-21T08:14:22.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 1.082923951s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
15872024-12-21T08:14:22.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e") failed: Property not found. retry in 1.475491685s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
15882024-12-21T08:14:22.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 701.051111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
15892024-12-21T08:14:22.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47") failed: Property not found. retry in 952.921388ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
15902024-12-21T08:14:22.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.004528288s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
15912024-12-21T08:14:22.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 1.43687134s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
15922024-12-21T08:14:22.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 1.166809314s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
15932024-12-21T08:14:22.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 776.15874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
15942024-12-21T08:14:22.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 1.379606344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
15952024-12-21T08:14:22.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 772.253997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
15962024-12-21T08:14:22.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 735.10804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
15972024-12-21T08:14:22.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba") failed: Property not found. retry in 856.339607ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
15982024-12-21T08:14:22.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67") failed: Property not found. retry in 1.438271309s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
15992024-12-21T08:14:22.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574") failed: Property not found. retry in 1.285559178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
16002024-12-21T08:14:23.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 527.534017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
16012024-12-21T08:14:23.120ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59470
16022024-12-21T08:14:23.125ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1229 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59470 req_id = 28faae08-4d14-45c7-af6a-8a73f154b4df response_code = 200 uri = /baseboard
16032024-12-21T08:14:23.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed") failed: Property not found. retry in 968.722009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
16042024-12-21T08:14:23.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6") failed: Property not found. retry in 1.003400256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
16052024-12-21T08:14:23.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 641.349243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
16062024-12-21T08:14:23.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662") failed: Property not found. retry in 955.867558ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
16072024-12-21T08:14:23.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f") failed: Property not found. retry in 796.663491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
16082024-12-21T08:14:23.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.079748515s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16092024-12-21T08:14:23.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2") failed: Property not found. retry in 1.474408141s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
16102024-12-21T08:14:23.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b") failed: Property not found. retry in 847.679062ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
16112024-12-21T08:14:23.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915") failed: Property not found. retry in 1.185511177s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
16122024-12-21T08:14:23.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b06f2be2-d169-4e82-b379-936275958456") failed: Property not found. retry in 804.517375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
16132024-12-21T08:14:23.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052") failed: Property not found. retry in 735.429629ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
16142024-12-21T08:14:23.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0") failed: Property not found. retry in 761.806677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
16152024-12-21T08:14:23.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c") failed: Property not found. retry in 1.072299886s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
16162024-12-21T08:14:24.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 621.868107ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16172024-12-21T08:14:25.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 590.857198ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16182024-12-21T08:14:25.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.44250992s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16192024-12-21T08:14:26.561ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.485728329s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
16202024-12-21T08:14:27.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.027448977s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16212024-12-21T08:14:28.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 718.679894ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16222024-12-21T08:14:28.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.313948755s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16232024-12-21T08:14:30.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.295610129s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16242024-12-21T08:14:31.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.197884758s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16252024-12-21T08:14:32.226ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.160814406s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"7b27e48f-58e9-452b-b613-b49b7b429b9e\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Sat, 21 Dec 2024 08:14:32 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"7b27e48f-58e9-452b-b613-b49b7b429b9e\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
16262024-12-21T08:14:32.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.083127974s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16272024-12-21T08:14:33.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.365556922s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16282024-12-21T08:14:35.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.378690594s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16292024-12-21T08:14:36.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 1.037144635s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16302024-12-21T08:14:37.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 830.532979ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16312024-12-21T08:14:38.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155") failed: Property not found. retry in 684.522843ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16322024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_83f27e44-8c25-498a-bc4d-a79778998f67
16332024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_f756aeba-d53c-41e8-bcaa-fe202743fee6
16342024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052
16352024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_b84f5db9-03af-4a33-8856-01cb4fcb8a8c
16362024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_f32db93d-bd49-40af-b49e-21286ae1d662
16372024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_be8b2cb3-ea6e-4709-8226-0a3ee9aa7db9
16382024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_0b706ed5-9c57-481f-a8ab-285b29250bed
16392024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_7ad25ac4-2c42-4f21-b95f-f2d49f6d5ed2
16402024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_591e4027-d937-4f19-bb67-082d5877b915
16412024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_e612ebb0-ce6a-4fd0-b96a-c2ad7b309c9f
16422024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_eb06ae20-0034-433f-9a1f-1af56f2ca574
16432024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_67643b43-461d-4a9a-b2c9-50310796834b
16442024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_75b64dc8-5e97-4be1-9e6c-ea78c81122ba
16452024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_86765e8c-dc79-4c52-9d92-7a5af48fd55f
16462024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_3f24b54a-b77a-46f2-bf47-e4bc27d280f0
16472024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_79540a52-e06e-42bc-84fa-4d123ac6fb47
16482024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_46aab58b-6e8e-4e0e-989a-65630375e33e
16492024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_db2b8c5f-7cd9-44fc-8af7-5086ba22c155
16502024-12-21T08:14:39.232ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_b06f2be2-d169-4e82-b379-936275958456
16512024-12-21T08:14:39.252ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16522024-12-21T08:14:39.254ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16532024-12-21T08:14:39.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46166384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44414 req_id = 5fee157f-af82-4302-af72-3e8ad6684342 response_code = 204 uri = /omicron-zones
16542024-12-21T08:14:39.301ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16552024-12-21T08:14:39.309ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16562024-12-21T08:14:39.313ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
16572024-12-21T08:14:39.361ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
16582024-12-21T08:14:41.148ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b1817489-745c-4cfb-9d2c-21b34313a546", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "b1817489-745c-4cfb-9d2c-21b34313a546" } file = sled-agent/src/rack_setup/service.rs:1078
16592024-12-21T08:14:41.494ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 17.373804588s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"17bd0ef4-dc6a-492d-9b20-9db6f14cc788\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Sat, 21 Dec 2024 08:14:41 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"17bd0ef4-dc6a-492d-9b20-9db6f14cc788\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
16602024-12-21T08:14:41.703ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f712cc23-a996-450f-9ed5-980f21452639", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "f712cc23-a996-450f-9ed5-980f21452639" } file = sled-agent/src/rack_setup/service.rs:1078
16612024-12-21T08:14:42.636ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7eeae6f7-2e2d-440e-904b-5490c5933280", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "7eeae6f7-2e2d-440e-904b-5490c5933280" } file = sled-agent/src/rack_setup/service.rs:1078
16622024-12-21T08:14:43.239ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "bb39b405-9f47-4b2c-83f0-30cd0ab78649", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "bb39b405-9f47-4b2c-83f0-30cd0ab78649" } file = sled-agent/src/rack_setup/service.rs:1078
16632024-12-21T08:14:43.822ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f84a4ee0-1e3f-4eac-ae08-8c48f3a6a687", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "f84a4ee0-1e3f-4eac-ae08-8c48f3a6a687" } file = sled-agent/src/rack_setup/service.rs:1078
16642024-12-21T08:14:44.796ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "708e0353-ee03-4b4e-8a73-5e36f60fdcad", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "708e0353-ee03-4b4e-8a73-5e36f60fdcad" } file = sled-agent/src/rack_setup/service.rs:1078
16652024-12-21T08:14:45.349ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "80e6367a-b2c6-4692-a984-eed2db2172e5", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "80e6367a-b2c6-4692-a984-eed2db2172e5" } file = sled-agent/src/rack_setup/service.rs:1078
16662024-12-21T08:14:46.410ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1e6eb8da-50d0-44f7-b866-79b3ef70afb1", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "1e6eb8da-50d0-44f7-b866-79b3ef70afb1" } file = sled-agent/src/rack_setup/service.rs:1078
16672024-12-21T08:14:46.897ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ece2911a-89db-467e-b313-8c54da1b0778", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "ece2911a-89db-467e-b313-8c54da1b0778" } file = sled-agent/src/rack_setup/service.rs:1078
16682024-12-21T08:14:48.115ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a1dddbd1-e270-4c2f-b4dc-f8202ee0e062", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "a1dddbd1-e270-4c2f-b4dc-f8202ee0e062" } file = sled-agent/src/rack_setup/service.rs:1078
16692024-12-21T08:14:48.779ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "05316d7d-1957-4e98-bccc-f279b1358855", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "05316d7d-1957-4e98-bccc-f279b1358855" } file = sled-agent/src/rack_setup/service.rs:1078
16702024-12-21T08:14:49.949ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d97f9d60-8909-4a35-b16d-9b1741d83c77", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "d97f9d60-8909-4a35-b16d-9b1741d83c77" } file = sled-agent/src/rack_setup/service.rs:1078
16712024-12-21T08:14:51.003ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a88c290c-0b1d-4448-9f38-c0ee9c143eaa", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "a88c290c-0b1d-4448-9f38-c0ee9c143eaa" } file = sled-agent/src/rack_setup/service.rs:1078
16722024-12-21T08:14:51.755ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "93c522f9-08ce-4250-8bc4-628fd7e2c5c8", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "93c522f9-08ce-4250-8bc4-628fd7e2c5c8" } file = sled-agent/src/rack_setup/service.rs:1078
16732024-12-21T08:14:53.150ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "78525d72-6e9a-47c1-aafb-b98c1369a29c", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "78525d72-6e9a-47c1-aafb-b98c1369a29c" } file = sled-agent/src/rack_setup/service.rs:1078
16742024-12-21T08:14:53.161ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32869
16752024-12-21T08:14:53.161ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32869 req_id = 02e58baf-4fe2-4188-b4d3-3ab771a3b39f response_code = 200 uri = /baseboard
16762024-12-21T08:14:54.851ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e62c089c-be86-49fd-892f-534a82236509", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "e62c089c-be86-49fd-892f-534a82236509" } file = sled-agent/src/rack_setup/service.rs:1078
16772024-12-21T08:14:56.792ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "016e5dfa-5852-4c5b-8d0a-702867a8e5dc", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "016e5dfa-5852-4c5b-8d0a-702867a8e5dc" } file = sled-agent/src/rack_setup/service.rs:1078
16782024-12-21T08:14:59.070ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "171aeb91-df3b-4937-926b-2de573f90716", "content-length": "173", "date": "Sat, 21 Dec 2024 08:14:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "171aeb91-df3b-4937-926b-2de573f90716" } file = sled-agent/src/rack_setup/service.rs:1078
16792024-12-21T08:15:01.814ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ad55b243-9940-4f21-804b-51577447eed8", "content-length": "173", "date": "Sat, 21 Dec 2024 08:15:01 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "ad55b243-9940-4f21-804b-51577447eed8" } file = sled-agent/src/rack_setup/service.rs:1078
16802024-12-21T08:15:03.662ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "eee52718-a689-4c9a-bd34-dc23fd8dd600", "content-length": "173", "date": "Sat, 21 Dec 2024 08:15:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "eee52718-a689-4c9a-bd34-dc23fd8dd600" } file = sled-agent/src/rack_setup/service.rs:1078
16812024-12-21T08:15:06.398ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5c7fb229-3dee-458e-9393-631d8b262517", "content-length": "173", "date": "Sat, 21 Dec 2024 08:15:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "5c7fb229-3dee-458e-9393-631d8b262517" } file = sled-agent/src/rack_setup/service.rs:1078
16822024-12-21T08:15:09.632ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a8e538a9-dab1-41cc-9b5c-301f15d6e074", "content-length": "173", "date": "Sat, 21 Dec 2024 08:15:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "a8e538a9-dab1-41cc-9b5c-301f15d6e074" } file = sled-agent/src/rack_setup/service.rs:1078
16832024-12-21T08:15:12.780ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5320fe99-8344-4deb-ab02-b1fa80e5fc80", "content-length": "173", "date": "Sat, 21 Dec 2024 08:15:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "5320fe99-8344-4deb-ab02-b1fa80e5fc80" } file = sled-agent/src/rack_setup/service.rs:1078
16842024-12-21T08:15:20.580ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9f718d10-3b6e-49b2-87b0-b31860877e92", "content-length": "173", "date": "Sat, 21 Dec 2024 08:15:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"118e564e-0bce-46c7-b69d-5b3dee81ed48\"", request_id: "9f718d10-3b6e-49b2-87b0-b31860877e92" } file = sled-agent/src/rack_setup/service.rs:1078
16852024-12-21T08:15:22.580ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
16862024-12-21T08:15:22.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44779
16872024-12-21T08:15:22.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16882024-12-21T08:15:22.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16892024-12-21T08:15:22.673ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:177
16902024-12-21T08:15:22.673ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:177
16912024-12-21T08:15:22.686ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16922024-12-21T08:15:22.686ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9
16932024-12-21T08:15:22.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16942024-12-21T08:15:22.711ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf
16952024-12-21T08:15:22.735ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16962024-12-21T08:15:22.735ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f6f464f-c123-4470-96c3-74700df96380
16972024-12-21T08:15:22.756ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16982024-12-21T08:15:22.756ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e
16992024-12-21T08:15:22.776ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17002024-12-21T08:15:22.776ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12
17012024-12-21T08:15:22.797ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17022024-12-21T08:15:22.797ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c782891-c1e8-4191-bfea-a3d07d39b468
17032024-12-21T08:15:22.817ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17042024-12-21T08:15:22.817ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a
17052024-12-21T08:15:22.837ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17062024-12-21T08:15:22.837ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb
17072024-12-21T08:15:22.856ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17082024-12-21T08:15:22.856ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f
17092024-12-21T08:15:22.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196571 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44779 req_id = 22e7e538-910f-42a3-b98b-2f251473bf7e response_code = 200 uri = /inventory
17102024-12-21T08:15:23.193ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44795
17112024-12-21T08:15:23.194ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44795 req_id = dd227545-8fe7-42cc-8cdb-21b9ce3280da response_code = 200 uri = /baseboard
17122024-12-21T08:15:30.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58770
17132024-12-21T08:15:30.682ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17142024-12-21T08:15:30.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17152024-12-21T08:15:30.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17162024-12-21T08:15:30.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17172024-12-21T08:15:30.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17182024-12-21T08:15:30.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17192024-12-21T08:15:30.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17202024-12-21T08:15:30.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2805 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58770 req_id = 3d5f061c-70b2-4d8d-b297-39c70f93b6e2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17212024-12-21T08:15:30.684ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
17222024-12-21T08:15:30.687ZINFOSledAgent (RSS): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17232024-12-21T08:15:30.687ZINFOSledAgent (RSS): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17242024-12-21T08:15:31.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61987
17252024-12-21T08:15:31.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17262024-12-21T08:15:31.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17272024-12-21T08:15:31.049ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:177
17282024-12-21T08:15:31.050ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:177
17292024-12-21T08:15:31.062ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17302024-12-21T08:15:31.062ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9
17312024-12-21T08:15:31.087ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17322024-12-21T08:15:31.087ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf
17332024-12-21T08:15:31.110ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17342024-12-21T08:15:31.110ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f6f464f-c123-4470-96c3-74700df96380
17352024-12-21T08:15:31.130ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17362024-12-21T08:15:31.130ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e
17372024-12-21T08:15:31.150ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17382024-12-21T08:15:31.150ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12
17392024-12-21T08:15:31.171ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17402024-12-21T08:15:31.171ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c782891-c1e8-4191-bfea-a3d07d39b468
17412024-12-21T08:15:31.192ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17422024-12-21T08:15:31.192ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a
17432024-12-21T08:15:31.213ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17442024-12-21T08:15:31.213ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb
17452024-12-21T08:15:31.234ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17462024-12-21T08:15:31.235ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f
17472024-12-21T08:15:31.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197091 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61987 req_id = 8724dfc6-2a9c-4e16-8e0f-82828a9d00b4 response_code = 200 uri = /inventory
17482024-12-21T08:15:31.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49333
17492024-12-21T08:15:31.506ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17502024-12-21T08:15:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17512024-12-21T08:15:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17522024-12-21T08:15:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17532024-12-21T08:15:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17542024-12-21T08:15:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17552024-12-21T08:15:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17562024-12-21T08:15:31.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49333 req_id = 435211b1-18f8-4ead-a280-bc0e5b2c615a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17572024-12-21T08:15:31.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43624
17582024-12-21T08:15:31.941ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17592024-12-21T08:15:31.941ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17602024-12-21T08:15:31.941ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17612024-12-21T08:15:31.941ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17622024-12-21T08:15:31.941ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17632024-12-21T08:15:31.941ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17642024-12-21T08:15:31.941ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17652024-12-21T08:15:31.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43624 req_id = 000598c8-e1ac-4b62-ab71-5e99ac86ac51 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17662024-12-21T08:15:32.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53576
17672024-12-21T08:15:32.013ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17682024-12-21T08:15:32.013ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17692024-12-21T08:15:32.013ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17702024-12-21T08:15:32.013ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17712024-12-21T08:15:32.013ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17722024-12-21T08:15:32.014ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17732024-12-21T08:15:32.014ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17742024-12-21T08:15:32.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53576 req_id = d15481a7-f4e2-4b4d-a2ca-9dd62b3b0c15 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17752024-12-21T08:15:38.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53623
17762024-12-21T08:15:38.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53623 req_id = 0ef2c5a0-66c6-4594-8701-5d143dc8841a response_code = 200 uri = /vpc-routes
17772024-12-21T08:15:38.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49580
17782024-12-21T08:15:38.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49580 req_id = 6fc068f1-0d02-4b38-8453-71fd47f96a20 response_code = 200 uri = /vpc-routes
17792024-12-21T08:15:38.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
17802024-12-21T08:15:38.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1449 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53623 req_id = 1caca3a6-e9a6-4e02-98d1-f833c84e8ff6 response_code = 204 uri = /eip-gateways
17812024-12-21T08:15:38.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
17822024-12-21T08:15:38.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49580 req_id = 305b5a43-745f-4a04-bd67-daf86328f8cd response_code = 204 uri = /eip-gateways
17832024-12-21T08:15:38.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53235
17842024-12-21T08:15:38.809ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17852024-12-21T08:15:38.887ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17862024-12-21T08:15:38.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171649 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53235 req_id = 6771c4d7-902f-4ede-a353-6e70124035e2 response_code = 204 uri = /switch-ports
17872024-12-21T08:15:38.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55065
17882024-12-21T08:15:38.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62069
17892024-12-21T08:15:38.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62069 req_id = 1d4e5148-522e-4970-80af-7984a1f80968 response_code = 200 uri = /vpc-routes
17902024-12-21T08:15:38.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55065 req_id = f6809de8-4097-4270-a4bd-abcf12dfcdf1 response_code = 200 uri = /v2p
17912024-12-21T08:15:38.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7396 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53235 req_id = e8ef6326-4bb0-4039-ae88-4d1e2e6da786 response_code = 200 uri = /network-bootstore-config
17922024-12-21T08:15:39.007ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
17932024-12-21T08:15:39.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62069 req_id = a22fa5d0-df77-4d59-8a1c-adee48f18296 response_code = 204 uri = /eip-gateways
17942024-12-21T08:15:39.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49580 req_id = 7b4c2f44-ce3e-4319-86a8-f177da2289d4 response_code = 204 uri = /vpc-routes
17952024-12-21T08:15:39.262ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17962024-12-21T08:15:39.262ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17972024-12-21T08:15:39.263ZINFOSledAgent (bootstore): Writing ledger to /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17982024-12-21T08:15:39.264ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17992024-12-21T08:15:39.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4672 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53235 req_id = 878b98af-d520-4202-84ac-d04524dfdccc response_code = 204 uri = /network-bootstore-config
18002024-12-21T08:15:39.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49100
18012024-12-21T08:15:39.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49100 req_id = 9c59a61e-f4bb-4e0b-8dcc-8937c5aa2305 response_code = 200 uri = /v2p
18022024-12-21T08:15:39.349ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18032024-12-21T08:15:39.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53623 req_id = 24d811a7-149e-452f-a168-abffc440e66f response_code = 204 uri = /vpc-routes
18042024-12-21T08:15:39.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61918
18052024-12-21T08:15:39.370ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18062024-12-21T08:15:39.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18072024-12-21T08:15:39.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114971 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61918 req_id = d1c56e96-c587-4e67-8189-4710843b3f8e response_code = 204 uri = /switch-ports
18082024-12-21T08:15:39.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61054
18092024-12-21T08:15:39.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55351
18102024-12-21T08:15:39.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18112024-12-21T08:15:39.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7872 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61918 req_id = 2bf796ad-0caa-4eec-8dde-7ccd7253c590 response_code = 200 uri = /network-bootstore-config
18122024-12-21T08:15:39.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7871 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61054 req_id = 75b98252-e707-43a7-a13e-69018985b31b response_code = 200 uri = /v2p
18132024-12-21T08:15:39.532ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18142024-12-21T08:15:39.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112721 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55351 req_id = 69714a15-e9c3-41f8-a482-6cd6eec80e2c response_code = 204 uri = /switch-ports
18152024-12-21T08:15:39.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55351 req_id = d84ca22b-970c-4c22-946a-1c18b51ea8d3 response_code = 200 uri = /network-bootstore-config
18162024-12-21T08:15:39.630ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18172024-12-21T08:15:39.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 425 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62069 req_id = dea247a9-67f4-48a5-ad3c-dec49acc1093 response_code = 204 uri = /vpc-routes
18182024-12-21T08:15:39.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65135
18192024-12-21T08:15:39.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65135 req_id = 18c3b803-9b9f-4e89-85f8-5952f53a7431 response_code = 200 uri = /vpc-routes
18202024-12-21T08:15:39.825ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
18212024-12-21T08:15:39.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65135 req_id = 556c18ca-0014-4fa0-adc1-578d91140ab1 response_code = 204 uri = /eip-gateways
18222024-12-21T08:15:39.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65135 req_id = 12933934-a924-4ae8-8af9-9da03a62194f response_code = 204 uri = /vpc-routes
18232024-12-21T08:15:43.884ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:62812 remote_addr = [fd00:1122:3344:101::d]:42396 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
18242024-12-21T08:15:43.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33705 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = c13b4d86-80fa-4d21-bbff-2542bc00f3c0 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
18252024-12-21T08:15:53.229ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62410
18262024-12-21T08:15:53.229ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62410 req_id = f5651723-c08d-4b6c-adca-d8d2cb17edd0 response_code = 200 uri = /baseboard
18272024-12-21T08:16:08.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49907
18282024-12-21T08:16:08.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49907 req_id = 0119ce4d-1253-4e12-9306-dfc2a616e7da response_code = 200 uri = /vpc-routes
18292024-12-21T08:16:08.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45633
18302024-12-21T08:16:08.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45633 req_id = a82ea9f8-63aa-4584-b9d3-ea051ce26f57 response_code = 200 uri = /vpc-routes
18312024-12-21T08:16:08.475ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
18322024-12-21T08:16:08.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49907 req_id = 979187cf-4c78-4a0a-9a03-9bf3b5994534 response_code = 204 uri = /eip-gateways
18332024-12-21T08:16:08.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49907 req_id = 5b556aa7-38a0-4201-ad7b-25932dc9dcc6 response_code = 204 uri = /vpc-routes
18342024-12-21T08:16:08.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
18352024-12-21T08:16:08.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45633 req_id = fa90c2f8-be88-4455-a779-c6391c999130 response_code = 204 uri = /eip-gateways
18362024-12-21T08:16:08.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35001
18372024-12-21T08:16:08.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35001 req_id = 07c7b3f6-df84-46c2-b046-024d7380bd26 response_code = 200 uri = /v2p
18382024-12-21T08:16:08.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45633 req_id = a3886c0b-1d07-4fb6-b45b-55e60508e128 response_code = 204 uri = /vpc-routes
18392024-12-21T08:16:08.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54202
18402024-12-21T08:16:08.596ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18412024-12-21T08:16:08.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18422024-12-21T08:16:08.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54202 req_id = e238262f-46ed-45a0-bf27-c2fdc6e92b42 response_code = 204 uri = /switch-ports
18432024-12-21T08:16:08.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47049
18442024-12-21T08:16:08.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39323
18452024-12-21T08:16:08.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54202 req_id = 398f2b7c-6590-4e9d-b265-628ad674a1fc response_code = 200 uri = /network-bootstore-config
18462024-12-21T08:16:08.709ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18472024-12-21T08:16:08.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39323 req_id = ae88b8b2-35b4-4ac4-8e2b-b1f2f6d16fb0 response_code = 200 uri = /v2p
18482024-12-21T08:16:08.759ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18492024-12-21T08:16:08.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47049 req_id = a124dbd2-2d57-4018-b5bd-e6ee34c1e6ed response_code = 204 uri = /switch-ports
18502024-12-21T08:16:08.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47049 req_id = f9d183bb-578d-4919-88b7-1c91350e7a3d response_code = 200 uri = /network-bootstore-config
18512024-12-21T08:16:08.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37053
18522024-12-21T08:16:08.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37053 req_id = 3393ed3d-ab9f-41e6-9e9b-4b7420276765 response_code = 200 uri = /vpc-routes
18532024-12-21T08:16:08.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
18542024-12-21T08:16:08.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37053 req_id = c7e56312-7769-49c3-a928-1c428bc28985 response_code = 204 uri = /eip-gateways
18552024-12-21T08:16:08.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37053 req_id = 83123242-7290-4a33-8757-c6d88aabfcef response_code = 204 uri = /vpc-routes
18562024-12-21T08:16:08.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35268
18572024-12-21T08:16:08.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35268 req_id = 965989ff-3b75-4f67-8f50-5c6f0bd3a826 response_code = 200 uri = /v2p
18582024-12-21T08:16:09.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63967
18592024-12-21T08:16:09.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18602024-12-21T08:16:09.058ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18612024-12-21T08:16:09.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91554 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63967 req_id = bfb6ef7d-4a35-42d5-87e2-bad26db17c65 response_code = 204 uri = /switch-ports
18622024-12-21T08:16:09.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63967 req_id = a41214ac-180b-42b0-9130-061cadc92268 response_code = 200 uri = /network-bootstore-config
18632024-12-21T08:16:13.893ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9517 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 1dc18b46-d097-48de-a8ca-d317ac5a5c76 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
18642024-12-21T08:16:23.265ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38769
18652024-12-21T08:16:23.265ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38769 req_id = d1a0cf87-5b98-4e86-9edb-700a5fe1ca00 response_code = 200 uri = /baseboard
18662024-12-21T08:16:38.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47758
18672024-12-21T08:16:38.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47758 req_id = 8c107c47-8e14-40d0-98a3-c8f63a420dcd response_code = 200 uri = /vpc-routes
18682024-12-21T08:16:38.561ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
18692024-12-21T08:16:38.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47758 req_id = da16020d-ab0e-422b-9729-3d25856eb473 response_code = 204 uri = /eip-gateways
18702024-12-21T08:16:38.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47758 req_id = cec4a931-3d2a-4bce-8f1d-47816847d79a response_code = 204 uri = /vpc-routes
18712024-12-21T08:16:38.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39697
18722024-12-21T08:16:38.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39697 req_id = 2a0c2343-1c2a-4dea-8377-59a61c353fa4 response_code = 200 uri = /v2p
18732024-12-21T08:16:38.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52332
18742024-12-21T08:16:38.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52332 req_id = 4d586159-f407-4f0f-aa5f-1dbfd1da8ef3 response_code = 200 uri = /vpc-routes
18752024-12-21T08:16:38.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
18762024-12-21T08:16:38.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52332 req_id = eb5b23b1-1ab5-4737-8237-a762ad19586d response_code = 204 uri = /eip-gateways
18772024-12-21T08:16:38.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52332 req_id = b564c033-9e2e-4777-a711-1b128c1492ed response_code = 204 uri = /vpc-routes
18782024-12-21T08:16:38.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33772
18792024-12-21T08:16:38.832ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18802024-12-21T08:16:38.873ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18812024-12-21T08:16:38.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103450 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33772 req_id = 21608fd9-99a4-4734-82fd-5e26fb51d691 response_code = 204 uri = /switch-ports
18822024-12-21T08:16:38.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53250
18832024-12-21T08:16:38.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53250 req_id = a1afad19-41ad-4792-a941-73e664ac95bc response_code = 200 uri = /v2p
18842024-12-21T08:16:38.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33772 req_id = a490fb56-8192-4ace-a5c9-01a79a216782 response_code = 200 uri = /network-bootstore-config
18852024-12-21T08:16:39.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55286
18862024-12-21T08:16:39.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55286 req_id = 1d570b93-cb3a-4b49-b20c-bf1728df8445 response_code = 200 uri = /vpc-routes
18872024-12-21T08:16:39.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
18882024-12-21T08:16:39.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55286 req_id = ace29b4c-eec1-437e-81a2-68cb5de0fda8 response_code = 204 uri = /eip-gateways
18892024-12-21T08:16:39.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55286 req_id = 6096ff13-e421-4eea-ba14-2fcfd31a00ba response_code = 204 uri = /vpc-routes
18902024-12-21T08:16:39.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46909
18912024-12-21T08:16:39.129ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18922024-12-21T08:16:39.166ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18932024-12-21T08:16:39.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92958 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46909 req_id = 663e63fd-b472-4aad-b141-336b09178dc0 response_code = 204 uri = /switch-ports
18942024-12-21T08:16:39.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45780
18952024-12-21T08:16:39.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50266
18962024-12-21T08:16:39.222ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18972024-12-21T08:16:39.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3914 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45780 req_id = df271c94-30f9-4a82-b781-23f2b0dfae7c response_code = 200 uri = /v2p
18982024-12-21T08:16:39.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46909 req_id = 0684eaca-076d-4e5c-8f2f-6c9ed2882c80 response_code = 200 uri = /network-bootstore-config
18992024-12-21T08:16:39.263ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19002024-12-21T08:16:39.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50266 req_id = b3476210-e2af-427b-909a-1bb3f89861a3 response_code = 204 uri = /switch-ports
19012024-12-21T08:16:39.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50266 req_id = 695b7867-3f7a-4378-8392-d2f9a05c7994 response_code = 200 uri = /network-bootstore-config
19022024-12-21T08:16:43.892ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7743 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 9be5994e-919b-4112-b1c0-e3fbd9d02b04 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
19032024-12-21T08:16:53.298ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53688
19042024-12-21T08:16:53.299ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53688 req_id = 89c227aa-476e-41f6-b24e-b2d20c0675d9 response_code = 200 uri = /baseboard
19052024-12-21T08:17:08.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46090
19062024-12-21T08:17:08.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46090 req_id = a4c13bd3-2a4d-4663-9a82-5df22834ec07 response_code = 200 uri = /v2p
19072024-12-21T08:17:08.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62849
19082024-12-21T08:17:08.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62849 req_id = 0fc1c204-affc-49af-b4fe-5882701e3edc response_code = 200 uri = /vpc-routes
19092024-12-21T08:17:08.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59579
19102024-12-21T08:17:08.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59579 req_id = ad11e019-e557-404c-a297-39b8cc239539 response_code = 200 uri = /vpc-routes
19112024-12-21T08:17:08.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
19122024-12-21T08:17:08.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59579 req_id = 37a29943-7ef8-47f3-9de5-0eaf0bace634 response_code = 204 uri = /eip-gateways
19132024-12-21T08:17:08.558ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
19142024-12-21T08:17:08.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62849 req_id = 3d572143-11c4-4dc0-9dc6-6438155a8434 response_code = 204 uri = /eip-gateways
19152024-12-21T08:17:08.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42071
19162024-12-21T08:17:08.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19172024-12-21T08:17:08.599ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19182024-12-21T08:17:08.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101504 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42071 req_id = ffbcb5af-d702-4fc8-96a3-43125149fa62 response_code = 204 uri = /switch-ports
19192024-12-21T08:17:08.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53369
19202024-12-21T08:17:08.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 408 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62849 req_id = 2453df83-4ccb-4a53-8261-6a5720f74ee8 response_code = 204 uri = /vpc-routes
19212024-12-21T08:17:08.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42071 req_id = 20c59aab-5438-4814-a996-963819f77b52 response_code = 200 uri = /network-bootstore-config
19222024-12-21T08:17:08.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53369 req_id = 020711fd-d3a4-4292-ba8f-aa90a316ca2d response_code = 200 uri = /v2p
19232024-12-21T08:17:08.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59579 req_id = 552392c9-150f-4c35-b276-461185c8063f response_code = 204 uri = /vpc-routes
19242024-12-21T08:17:08.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47211
19252024-12-21T08:17:08.676ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19262024-12-21T08:17:08.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19272024-12-21T08:17:08.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112460 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47211 req_id = d608b483-df30-472a-baa8-0e06672c8bb8 response_code = 204 uri = /switch-ports
19282024-12-21T08:17:08.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47211 req_id = 083e4c6a-e831-4b81-b8ec-6b13e23ca0c8 response_code = 200 uri = /network-bootstore-config
19292024-12-21T08:17:08.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48614
19302024-12-21T08:17:08.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48614 req_id = 4d203b8b-ab16-42fd-9158-21e4f73cf2a9 response_code = 200 uri = /vpc-routes
19312024-12-21T08:17:08.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
19322024-12-21T08:17:08.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48614 req_id = e601f15f-98f7-4f6d-be95-fb4713ef311d response_code = 204 uri = /eip-gateways
19332024-12-21T08:17:08.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48614 req_id = ba144302-9f80-4f9d-96e3-aa022758d1cc response_code = 204 uri = /vpc-routes
19342024-12-21T08:17:08.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41434
19352024-12-21T08:17:08.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41434 req_id = 8700e4f3-4778-4d38-8b7f-daef1c0256c0 response_code = 200 uri = /v2p
19362024-12-21T08:17:09.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56668
19372024-12-21T08:17:09.105ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19382024-12-21T08:17:09.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19392024-12-21T08:17:09.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95094 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56668 req_id = 9d8ff73f-62cc-4da8-a361-9db0967e70b6 response_code = 204 uri = /switch-ports
19402024-12-21T08:17:09.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56668 req_id = 79472b98-dbb0-4635-ab9b-b3b5170d6f8f response_code = 200 uri = /network-bootstore-config
19412024-12-21T08:17:13.890ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6338 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = e6e641ce-155a-4b71-bcb3-56cba376c840 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
19422024-12-21T08:17:23.333ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56295
19432024-12-21T08:17:23.333ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56295 req_id = 093cf298-fbc3-4265-b0e4-cea10d796950 response_code = 200 uri = /baseboard
19442024-12-21T08:17:38.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39385
19452024-12-21T08:17:38.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39385 req_id = 1dab88c8-c828-4e69-ae87-73845798e752 response_code = 200 uri = /vpc-routes
19462024-12-21T08:17:38.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
19472024-12-21T08:17:38.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39385 req_id = 22dc301e-9986-4496-a4b3-e3b470a93c2a response_code = 204 uri = /eip-gateways
19482024-12-21T08:17:38.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39385 req_id = 2ffb12ed-05a7-44a4-8f73-817e2ab9a110 response_code = 204 uri = /vpc-routes
19492024-12-21T08:17:38.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51506
19502024-12-21T08:17:38.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51506 req_id = 497cb067-44c4-447b-b268-20c39797527f response_code = 200 uri = /vpc-routes
19512024-12-21T08:17:38.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33633
19522024-12-21T08:17:38.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33633 req_id = dcc2e986-ce3b-4cf3-ac2b-d00ef188b019 response_code = 200 uri = /v2p
19532024-12-21T08:17:38.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38216
19542024-12-21T08:17:38.679ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19552024-12-21T08:17:38.730ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19562024-12-21T08:17:38.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115768 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38216 req_id = c4ed43bf-4dcf-4247-921e-32db8568c871 response_code = 204 uri = /switch-ports
19572024-12-21T08:17:38.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38216 req_id = 41e589fe-0672-4b05-a310-edbe2cfe1daf response_code = 200 uri = /network-bootstore-config
19582024-12-21T08:17:38.795ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
19592024-12-21T08:17:38.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51506 req_id = 92b127c3-d5a2-42cd-82d0-b9d789e20240 response_code = 204 uri = /eip-gateways
19602024-12-21T08:17:38.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51506 req_id = 19fa78fa-c9a6-43ac-a23e-c66da8ddb555 response_code = 204 uri = /vpc-routes
19612024-12-21T08:17:38.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42551
19622024-12-21T08:17:38.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42551 req_id = bc68482a-266a-4172-ba75-4e3625024366 response_code = 200 uri = /v2p
19632024-12-21T08:17:38.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55360
19642024-12-21T08:17:38.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55360 req_id = 11d400a2-8c58-4397-b849-10f8a437ba48 response_code = 200 uri = /vpc-routes
19652024-12-21T08:17:39.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
19662024-12-21T08:17:39.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55360 req_id = 334ab520-d49b-4410-8d68-ee9b1c5cf3ed response_code = 204 uri = /eip-gateways
19672024-12-21T08:17:39.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39113
19682024-12-21T08:17:39.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39113 req_id = 2453759f-1790-475d-b858-11ae892165fc response_code = 200 uri = /v2p
19692024-12-21T08:17:39.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45528
19702024-12-21T08:17:39.092ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19712024-12-21T08:17:39.130ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19722024-12-21T08:17:39.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45528 req_id = 39cd461f-cdbc-4c95-bfbe-1d40a1f5442e response_code = 204 uri = /switch-ports
19732024-12-21T08:17:39.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40355
19742024-12-21T08:17:39.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45528 req_id = 6323dc25-b393-4c04-b949-6b17165880a7 response_code = 200 uri = /network-bootstore-config
19752024-12-21T08:17:39.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19762024-12-21T08:17:39.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5474 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55360 req_id = 0c0c8138-3299-47d8-8142-478f77d1082c response_code = 204 uri = /vpc-routes
19772024-12-21T08:17:39.234ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19782024-12-21T08:17:39.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86099 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40355 req_id = b7b608cf-9d04-49b2-b35d-f9679b97f62f response_code = 204 uri = /switch-ports
19792024-12-21T08:17:39.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40355 req_id = e5d3296e-5c95-47f3-bbb4-b50796cbb5a4 response_code = 200 uri = /network-bootstore-config
19802024-12-21T08:17:43.891ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6749 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = bd763e39-62ae-4267-90bf-ba6e453e0645 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
19812024-12-21T08:17:44.834ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19822024-12-21T08:17:53.367ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63397
19832024-12-21T08:17:53.367ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63397 req_id = 39e7cb0a-c40a-4946-9891-c7370abf2497 response_code = 200 uri = /baseboard
19842024-12-21T08:18:08.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57418
19852024-12-21T08:18:08.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57418 req_id = 8000e701-85ac-4525-b0a3-0cbddabbdfb3 response_code = 200 uri = /vpc-routes
19862024-12-21T08:18:08.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53169
19872024-12-21T08:18:08.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53169 req_id = 117a8621-babc-4b7e-98e1-be9932a36c8b response_code = 200 uri = /vpc-routes
19882024-12-21T08:18:08.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52337
19892024-12-21T08:18:08.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52337 req_id = 8ca76601-1288-4580-9ada-f600c5e4ca57 response_code = 200 uri = /v2p
19902024-12-21T08:18:08.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38701
19912024-12-21T08:18:08.470ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19922024-12-21T08:18:08.515ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19932024-12-21T08:18:08.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104571 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38701 req_id = 0e737c87-8bbd-4879-8ee3-122d4e9acb1e response_code = 204 uri = /switch-ports
19942024-12-21T08:18:08.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
19952024-12-21T08:18:08.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57418 req_id = 5563b9f4-464e-42ba-8023-f46d82ff48f3 response_code = 204 uri = /eip-gateways
19962024-12-21T08:18:08.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
19972024-12-21T08:18:08.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53169 req_id = fc546d9f-75b8-4edb-a777-d17b1744f851 response_code = 204 uri = /eip-gateways
19982024-12-21T08:18:08.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38701 req_id = 3a917a91-d7bf-449f-8364-b520ca07c0a6 response_code = 200 uri = /network-bootstore-config
19992024-12-21T08:18:08.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57418 req_id = 20b73404-6b4d-49b7-aefd-bcdf8a40161a response_code = 204 uri = /vpc-routes
20002024-12-21T08:18:08.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48302
20012024-12-21T08:18:08.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48302 req_id = c131af5a-f5cb-4bf7-96f2-3ef2f76742f2 response_code = 200 uri = /v2p
20022024-12-21T08:18:08.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53169 req_id = 251e00a9-5050-4470-bd85-b6c6a067cc50 response_code = 204 uri = /vpc-routes
20032024-12-21T08:18:08.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62646
20042024-12-21T08:18:08.680ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20052024-12-21T08:18:08.728ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20062024-12-21T08:18:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62646 req_id = 64e3b793-b1f3-4861-926f-75a1a1506704 response_code = 204 uri = /switch-ports
20072024-12-21T08:18:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62646 req_id = 429948ee-783f-409b-ba69-5aabc5919172 response_code = 200 uri = /network-bootstore-config
20082024-12-21T08:18:08.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65301
20092024-12-21T08:18:08.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65301 req_id = 9892a320-5d3a-4ba0-80b9-7fad6106aabb response_code = 200 uri = /v2p
20102024-12-21T08:18:08.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48164
20112024-12-21T08:18:08.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48164 req_id = 42fc76e2-ae5b-4786-aae5-ff8fc8e2d4d0 response_code = 200 uri = /vpc-routes
20122024-12-21T08:18:08.896ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
20132024-12-21T08:18:08.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48164 req_id = 812b29d7-f295-4d40-a903-ad8a20153b33 response_code = 204 uri = /eip-gateways
20142024-12-21T08:18:08.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48164 req_id = aa00cdc3-ca00-4d1f-9059-1461fbbfc9af response_code = 204 uri = /vpc-routes
20152024-12-21T08:18:09.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57271
20162024-12-21T08:18:09.076ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20172024-12-21T08:18:09.113ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20182024-12-21T08:18:09.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57271 req_id = 281eb13b-2d5b-48f3-b641-b6149a2a4717 response_code = 204 uri = /switch-ports
20192024-12-21T08:18:09.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57271 req_id = 86bdf027-a6df-4463-9d9e-2baa9c2e0e00 response_code = 200 uri = /network-bootstore-config
20202024-12-21T08:18:13.892ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7188 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = a2510943-7bca-43da-838a-e689cbb3a98a response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
20212024-12-21T08:18:23.401ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60389
20222024-12-21T08:18:23.401ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60389 req_id = 175e30fc-e5f9-4205-b3ee-c4903f89da18 response_code = 200 uri = /baseboard
20232024-12-21T08:18:38.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52461
20242024-12-21T08:18:38.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52461 req_id = e4ac23a9-cce1-40a5-a10f-a2475bfdc0e9 response_code = 200 uri = /vpc-routes
20252024-12-21T08:18:38.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
20262024-12-21T08:18:38.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52461 req_id = 399c7139-bbe5-4e55-ba25-372592370add response_code = 204 uri = /eip-gateways
20272024-12-21T08:18:38.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51858
20282024-12-21T08:18:38.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51858 req_id = 84912859-fed3-4262-a5ba-17de3d797a07 response_code = 200 uri = /vpc-routes
20292024-12-21T08:18:38.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38339
20302024-12-21T08:18:38.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38339 req_id = a79f48bb-a05d-4941-a130-1abffd163d0c response_code = 200 uri = /v2p
20312024-12-21T08:18:38.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52461 req_id = 58e6ca72-d707-4a72-b2bf-ef86478707cc response_code = 204 uri = /vpc-routes
20322024-12-21T08:18:38.655ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
20332024-12-21T08:18:38.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51858 req_id = 4828cebd-00ae-434d-bce6-5fed3ff9d07c response_code = 204 uri = /eip-gateways
20342024-12-21T08:18:38.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37767
20352024-12-21T08:18:38.662ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20362024-12-21T08:18:38.714ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20372024-12-21T08:18:38.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139208 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37767 req_id = 941b6004-32f0-4d45-aa8d-df297cbbfef2 response_code = 204 uri = /switch-ports
20382024-12-21T08:18:38.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51858 req_id = e43e59f5-b81c-41ae-94a1-c09f4365b687 response_code = 204 uri = /vpc-routes
20392024-12-21T08:18:38.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37767 req_id = 5f3b0999-2bfb-4520-86ac-67176afb80b6 response_code = 200 uri = /network-bootstore-config
20402024-12-21T08:18:38.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39251
20412024-12-21T08:18:38.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39251 req_id = d51f6309-9ae1-4ba6-99ec-188007d42f3c response_code = 200 uri = /v2p
20422024-12-21T08:18:38.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45239
20432024-12-21T08:18:38.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20442024-12-21T08:18:38.898ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20452024-12-21T08:18:38.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45239 req_id = a4a4e6e4-659b-4b69-80d7-1429dae3dd01 response_code = 204 uri = /switch-ports
20462024-12-21T08:18:38.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45239 req_id = f1a3558c-8efe-4631-ae18-1ba4250f3c22 response_code = 200 uri = /network-bootstore-config
20472024-12-21T08:18:38.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63173
20482024-12-21T08:18:38.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63173 req_id = 850daf76-fe10-4b03-9c6a-5c957d29f21c response_code = 200 uri = /vpc-routes
20492024-12-21T08:18:39.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
20502024-12-21T08:18:39.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63173 req_id = d031790d-485e-4539-bfe5-c5a53f295a55 response_code = 204 uri = /eip-gateways
20512024-12-21T08:18:39.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42076
20522024-12-21T08:18:39.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42076 req_id = 0621136b-33d7-4bed-a90e-9b550e6568fb response_code = 200 uri = /v2p
20532024-12-21T08:18:39.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63173 req_id = 1cee6832-226f-442c-82b7-3c5fa31718cf response_code = 204 uri = /vpc-routes
20542024-12-21T08:18:39.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63824
20552024-12-21T08:18:39.267ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20562024-12-21T08:18:39.304ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20572024-12-21T08:18:39.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63824 req_id = 8d46eda6-994f-4df1-b1ab-b31bd7609231 response_code = 204 uri = /switch-ports
20582024-12-21T08:18:39.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63824 req_id = 8e407cb4-a2f8-4b89-ae38-934db6084659 response_code = 200 uri = /network-bootstore-config
20592024-12-21T08:18:43.892ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7313 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = e29ff979-5f82-4e75-97ac-4a5551fbcf93 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
20602024-12-21T08:18:53.435ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46246
20612024-12-21T08:18:53.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46246 req_id = 675c8599-1227-414c-98a5-ebed56050a33 response_code = 200 uri = /baseboard
20622024-12-21T08:19:08.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53677
20632024-12-21T08:19:08.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53677 req_id = 4411ff54-e1b6-4a0f-8274-70b33d91f0fa response_code = 200 uri = /vpc-routes
20642024-12-21T08:19:08.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49906
20652024-12-21T08:19:08.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49906 req_id = 53356455-8ebc-42fa-b309-7bb9d2d2b34a response_code = 200 uri = /vpc-routes
20662024-12-21T08:19:08.422ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
20672024-12-21T08:19:08.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53677 req_id = 88d52871-4079-46ae-b1ff-83a282d220f4 response_code = 204 uri = /eip-gateways
20682024-12-21T08:19:08.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53677 req_id = 3ca9522b-430b-45ad-9be2-e5263b2bae3c response_code = 204 uri = /vpc-routes
20692024-12-21T08:19:08.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49127
20702024-12-21T08:19:08.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49127 req_id = fa347031-c1d0-4849-9dfa-59fcf4675575 response_code = 200 uri = /v2p
20712024-12-21T08:19:08.547ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
20722024-12-21T08:19:08.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49906 req_id = 5d72746f-fcb9-4b5c-a146-23fd276543a1 response_code = 204 uri = /eip-gateways
20732024-12-21T08:19:08.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42259
20742024-12-21T08:19:08.549ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20752024-12-21T08:19:08.589ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20762024-12-21T08:19:08.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97026 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42259 req_id = 95150ffb-fa4f-4d6b-99ff-f984b40997ee response_code = 204 uri = /switch-ports
20772024-12-21T08:19:08.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48038
20782024-12-21T08:19:08.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47630
20792024-12-21T08:19:08.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49906 req_id = b01a86e7-4a03-4b86-89b4-89511ac275b5 response_code = 204 uri = /vpc-routes
20802024-12-21T08:19:08.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42259 req_id = dbb852cb-ac23-4bc5-a3f7-839522f8e097 response_code = 200 uri = /network-bootstore-config
20812024-12-21T08:19:08.647ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20822024-12-21T08:19:08.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48038 req_id = 321bbd15-d97a-4394-b55d-920cc1d08e95 response_code = 200 uri = /v2p
20832024-12-21T08:19:08.694ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20842024-12-21T08:19:08.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119835 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47630 req_id = 227b5d95-fcd4-407c-b3f6-663bea807e22 response_code = 204 uri = /switch-ports
20852024-12-21T08:19:08.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47630 req_id = 5a141526-164a-4b88-b966-995868126299 response_code = 200 uri = /network-bootstore-config
20862024-12-21T08:19:08.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34840
20872024-12-21T08:19:08.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34840 req_id = e7c60e05-edad-419c-936c-3f9aa499f4da response_code = 200 uri = /v2p
20882024-12-21T08:19:08.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35145
20892024-12-21T08:19:08.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35145 req_id = d8392c92-5330-4f74-b668-181d1a521c3a response_code = 200 uri = /vpc-routes
20902024-12-21T08:19:08.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
20912024-12-21T08:19:08.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35145 req_id = b33971ff-9302-4aee-b2b1-32b69cc2e2c3 response_code = 204 uri = /eip-gateways
20922024-12-21T08:19:08.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35145 req_id = 654fba34-6a65-4dad-980f-1fb562ba15db response_code = 204 uri = /vpc-routes
20932024-12-21T08:19:08.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41137
20942024-12-21T08:19:08.911ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20952024-12-21T08:19:08.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20962024-12-21T08:19:09.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41137 req_id = 1fb45ee7-75a9-48af-940c-8e8d3b7c59be response_code = 204 uri = /switch-ports
20972024-12-21T08:19:09.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41137 req_id = 488d671c-8dd7-45fd-a5c3-ece5d7d52dd0 response_code = 200 uri = /network-bootstore-config
20982024-12-21T08:19:13.892ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7058 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = fd9c9b0e-d2b5-48c7-b1c0-bfb40ce8ad0d response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
20992024-12-21T08:19:23.468ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40115
21002024-12-21T08:19:23.468ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40115 req_id = e47cd216-6e75-4dc6-85db-a4c86562277e response_code = 200 uri = /baseboard
21012024-12-21T08:19:38.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60544
21022024-12-21T08:19:38.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60544 req_id = b3611ac9-023c-45c1-869b-530aed397cad response_code = 200 uri = /vpc-routes
21032024-12-21T08:19:38.504ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
21042024-12-21T08:19:38.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60544 req_id = 34b11759-d4f5-43bc-91b3-5f9b848b781e response_code = 204 uri = /eip-gateways
21052024-12-21T08:19:38.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60544 req_id = 80e1aa81-2686-4aa6-b82a-c061b181527a response_code = 204 uri = /vpc-routes
21062024-12-21T08:19:38.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60993
21072024-12-21T08:19:38.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60993 req_id = 9893217d-84f2-417d-a0ea-cc896bf1be27 response_code = 200 uri = /vpc-routes
21082024-12-21T08:19:38.628ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
21092024-12-21T08:19:38.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60993 req_id = 7aec52e6-a51d-4057-af56-51837bf6ef94 response_code = 204 uri = /eip-gateways
21102024-12-21T08:19:38.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60993 req_id = 6cf63bc1-f537-4354-a72c-3b8d8b79600f response_code = 204 uri = /vpc-routes
21112024-12-21T08:19:38.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60669
21122024-12-21T08:19:38.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60669 req_id = c15f16a1-e678-46a7-ad90-e396ee476401 response_code = 200 uri = /v2p
21132024-12-21T08:19:38.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50301
21142024-12-21T08:19:38.763ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21152024-12-21T08:19:38.817ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21162024-12-21T08:19:38.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126050 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50301 req_id = f36c4192-0f29-4796-ac16-53282a6f90fd response_code = 204 uri = /switch-ports
21172024-12-21T08:19:38.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55540
21182024-12-21T08:19:38.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48993
21192024-12-21T08:19:38.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34319
21202024-12-21T08:19:38.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50301 req_id = dd6fd381-1ae0-42c4-aaf8-935dea55430a response_code = 200 uri = /network-bootstore-config
21212024-12-21T08:19:38.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55540 req_id = 6f2ffee8-4236-4629-b30d-2414b87a58a0 response_code = 200 uri = /v2p
21222024-12-21T08:19:38.890ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21232024-12-21T08:19:38.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21242024-12-21T08:19:38.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21252024-12-21T08:19:38.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21262024-12-21T08:19:38.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21272024-12-21T08:19:38.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21282024-12-21T08:19:38.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21292024-12-21T08:19:38.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48993 req_id = f24800bf-a832-4f36-ba5d-231d3005c4a5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21302024-12-21T08:19:38.890ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21312024-12-21T08:19:38.932ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21322024-12-21T08:19:38.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33498
21332024-12-21T08:19:38.939ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21342024-12-21T08:19:38.939ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21352024-12-21T08:19:38.939ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21362024-12-21T08:19:38.939ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21372024-12-21T08:19:38.939ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21382024-12-21T08:19:38.939ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21392024-12-21T08:19:38.939ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21402024-12-21T08:19:38.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 447 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33498 req_id = 9f20c1b7-d84e-4b94-a7fa-8d076f3313c2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21412024-12-21T08:19:38.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34319 req_id = 883c9bb6-3f34-47d1-a50b-e4c85adbdf42 response_code = 204 uri = /switch-ports
21422024-12-21T08:19:38.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34319 req_id = e05a22b6-38d0-4f8d-94ab-5421c76d3d4d response_code = 200 uri = /network-bootstore-config
21432024-12-21T08:19:39.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48993
21442024-12-21T08:19:39.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48993 req_id = a79de786-1160-4d97-ac95-c9c76b790b3f response_code = 200 uri = /vpc-routes
21452024-12-21T08:19:39.124ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
21462024-12-21T08:19:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48993 req_id = 3e90ca5f-c47f-4a74-9c0a-4162a738d055 response_code = 204 uri = /eip-gateways
21472024-12-21T08:19:39.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55696
21482024-12-21T08:19:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55696 req_id = 8e0f0e4b-8624-4b7f-84b6-faa43b711b86 response_code = 200 uri = /v2p
21492024-12-21T08:19:39.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48993 req_id = b677e82f-0ec5-4387-aed0-04196c1363b4 response_code = 204 uri = /vpc-routes
21502024-12-21T08:19:39.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35554
21512024-12-21T08:19:39.259ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21522024-12-21T08:19:39.300ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21532024-12-21T08:19:39.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98963 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35554 req_id = a3364d26-450e-4664-915e-c43b369ce54d response_code = 204 uri = /switch-ports
21542024-12-21T08:19:39.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35554 req_id = 5070cceb-dba5-4ff0-a221-20246215694c response_code = 200 uri = /network-bootstore-config
21552024-12-21T08:19:39.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54441
21562024-12-21T08:19:39.475ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21572024-12-21T08:19:39.475ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21582024-12-21T08:19:39.475ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21592024-12-21T08:19:39.475ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21602024-12-21T08:19:39.475ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21612024-12-21T08:19:39.475ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21622024-12-21T08:19:39.475ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21632024-12-21T08:19:39.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54441 req_id = 4e26345f-2efb-45ee-869d-0a8cd8923dab response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21642024-12-21T08:19:43.892ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6985 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 4a824632-3681-47cb-a5b5-6dcc793918da response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
21652024-12-21T08:19:53.501ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55702
21662024-12-21T08:19:53.501ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55702 req_id = 8110fafe-ccd8-4b21-98df-35fd90fbca42 response_code = 200 uri = /baseboard
21672024-12-21T08:20:08.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48814
21682024-12-21T08:20:08.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48814 req_id = 3d9a3a43-c632-469f-9f9a-f48cc0deb113 response_code = 200 uri = /vpc-routes
21692024-12-21T08:20:08.362ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
21702024-12-21T08:20:08.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48814 req_id = 5e1cfd1f-ddf5-45b5-af84-93e7b85546a8 response_code = 204 uri = /eip-gateways
21712024-12-21T08:20:08.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48814 req_id = df21f4e5-5ebe-4970-bf8a-6188b56d6ef3 response_code = 204 uri = /vpc-routes
21722024-12-21T08:20:08.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45742
21732024-12-21T08:20:08.446ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21742024-12-21T08:20:08.486ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21752024-12-21T08:20:08.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45742 req_id = 0a665c0c-7ee1-42de-8c6c-8af0293318f9 response_code = 204 uri = /switch-ports
21762024-12-21T08:20:08.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55732
21772024-12-21T08:20:08.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45742 req_id = a1d5085d-7485-4f96-adf6-1d02f02c0646 response_code = 200 uri = /network-bootstore-config
21782024-12-21T08:20:08.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55732 req_id = 7871f6d5-8d4e-4c44-b8d7-34c1e8d4cbc4 response_code = 200 uri = /v2p
21792024-12-21T08:20:08.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41607
21802024-12-21T08:20:08.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41607 req_id = 85be4734-f14b-4ac9-b895-13905d1d0c87 response_code = 200 uri = /v2p
21812024-12-21T08:20:08.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52044
21822024-12-21T08:20:08.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52044 req_id = 29edf02b-9000-4285-b9d8-10a044009579 response_code = 200 uri = /vpc-routes
21832024-12-21T08:20:08.637ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
21842024-12-21T08:20:08.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52044 req_id = e8cdfc58-d461-47ff-879b-ffe67a4aa06a response_code = 204 uri = /eip-gateways
21852024-12-21T08:20:08.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52044 req_id = bdea1405-07d1-48bd-9e29-9323c6ffd11c response_code = 204 uri = /vpc-routes
21862024-12-21T08:20:08.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62276
21872024-12-21T08:20:08.672ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21882024-12-21T08:20:08.727ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21892024-12-21T08:20:08.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62276 req_id = 8e7c4698-3a9a-4f48-b60d-3194d9af258f response_code = 204 uri = /switch-ports
21902024-12-21T08:20:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62276 req_id = 65d5cae9-8751-4564-9d68-fb73753bfc5d response_code = 200 uri = /network-bootstore-config
21912024-12-21T08:20:08.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33801
21922024-12-21T08:20:08.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33801 req_id = 38a0a53a-5c49-48d0-8a63-ac7488fc0d43 response_code = 200 uri = /v2p
21932024-12-21T08:20:08.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52324
21942024-12-21T08:20:08.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52324 req_id = 2aa15ce1-c862-4375-9ef6-d934ce391822 response_code = 200 uri = /vpc-routes
21952024-12-21T08:20:08.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
21962024-12-21T08:20:08.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52324 req_id = 6cd68778-f6f7-407d-8b6e-90a2c268f638 response_code = 204 uri = /eip-gateways
21972024-12-21T08:20:08.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52324 req_id = b7c5946a-2567-4d47-bd9e-d7cbee5949a5 response_code = 204 uri = /vpc-routes
21982024-12-21T08:20:09.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42287
21992024-12-21T08:20:09.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22002024-12-21T08:20:09.065ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22012024-12-21T08:20:09.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93913 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42287 req_id = acbfaec7-aa63-479c-851d-bbf220685e5a response_code = 204 uri = /switch-ports
22022024-12-21T08:20:09.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42287 req_id = 5bf66590-8388-4245-9464-100b1c174f80 response_code = 200 uri = /network-bootstore-config
22032024-12-21T08:20:13.893ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8162 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = cfd9cbc6-368f-497b-8d7d-f10ef181cc03 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
22042024-12-21T08:20:23.534ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44450
22052024-12-21T08:20:23.535ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44450 req_id = be5e0fbc-2e92-479b-96c8-33f7e0564673 response_code = 200 uri = /baseboard
22062024-12-21T08:20:38.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51588
22072024-12-21T08:20:38.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51588 req_id = 82bc49e8-c5dd-4cff-85d7-edf4f2a2c800 response_code = 200 uri = /vpc-routes
22082024-12-21T08:20:38.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
22092024-12-21T08:20:38.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51588 req_id = e755f966-9573-4844-8c7d-8fea06d9aff7 response_code = 204 uri = /eip-gateways
22102024-12-21T08:20:38.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51588 req_id = bd8a8b21-5ba0-4c53-94bb-b938d87c5a57 response_code = 204 uri = /vpc-routes
22112024-12-21T08:20:38.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62172
22122024-12-21T08:20:38.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62172 req_id = d85d3e70-419e-44f1-8af4-daddf2638ff2 response_code = 200 uri = /v2p
22132024-12-21T08:20:38.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55028
22142024-12-21T08:20:38.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22152024-12-21T08:20:38.633ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22162024-12-21T08:20:38.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55028 req_id = 6968f2e1-a616-4c21-ba92-fa80be55a701 response_code = 204 uri = /switch-ports
22172024-12-21T08:20:38.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63869
22182024-12-21T08:20:38.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63869 req_id = f875960e-e75d-45d7-ba2b-84a0d5ab9d6a response_code = 200 uri = /vpc-routes
22192024-12-21T08:20:38.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55028 req_id = 9a85d5e1-0150-44b3-a2f0-6f3d62daf545 response_code = 200 uri = /network-bootstore-config
22202024-12-21T08:20:38.795ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
22212024-12-21T08:20:38.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63869 req_id = e61b0694-1bce-4bb3-a609-82b01438d873 response_code = 204 uri = /eip-gateways
22222024-12-21T08:20:38.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63869 req_id = e7fd6260-3c86-46ac-bc1d-6652ad5fb1b6 response_code = 204 uri = /vpc-routes
22232024-12-21T08:20:38.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64996
22242024-12-21T08:20:38.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64996 req_id = 46ec205c-77a0-4f65-81c1-747cf4287d1e response_code = 200 uri = /v2p
22252024-12-21T08:20:38.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49731
22262024-12-21T08:20:38.905ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22272024-12-21T08:20:38.943ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22282024-12-21T08:20:38.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91686 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49731 req_id = 70784620-a479-432b-b90c-fd725c875633 response_code = 204 uri = /switch-ports
22292024-12-21T08:20:38.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49731 req_id = bbf5ffa9-b91d-4563-971b-e7dae01bb0ca response_code = 200 uri = /network-bootstore-config
22302024-12-21T08:20:39.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52307
22312024-12-21T08:20:39.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52307 req_id = b547df7e-1434-4a52-a4bf-777369adef61 response_code = 200 uri = /vpc-routes
22322024-12-21T08:20:39.126ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
22332024-12-21T08:20:39.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52307 req_id = 798d6b4d-f28c-4e39-8130-01deaa41bb32 response_code = 204 uri = /eip-gateways
22342024-12-21T08:20:39.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52307 req_id = df18ab62-eb65-401b-afe1-c97ff887b5ba response_code = 204 uri = /vpc-routes
22352024-12-21T08:20:39.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51245
22362024-12-21T08:20:39.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51245 req_id = 692b9533-01c4-4377-bbcf-10c7fe4ecef2 response_code = 200 uri = /v2p
22372024-12-21T08:20:39.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42883
22382024-12-21T08:20:39.216ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22392024-12-21T08:20:39.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22402024-12-21T08:20:39.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42883 req_id = 099a678d-af7b-4b9a-9540-1cd89d725d46 response_code = 204 uri = /switch-ports
22412024-12-21T08:20:39.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3491 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42883 req_id = 21335905-bcb3-4ffa-8271-f2208022c3cf response_code = 200 uri = /network-bootstore-config
22422024-12-21T08:20:43.893ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7841 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 90efb8ef-d65d-4f07-9624-9cec6997bf91 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
22432024-12-21T08:20:53.567ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46244
22442024-12-21T08:20:53.567ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46244 req_id = feefaa44-0a4d-4302-a186-3603ca27604e response_code = 200 uri = /baseboard
22452024-12-21T08:21:08.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40544
22462024-12-21T08:21:08.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40544 req_id = 55b818d7-978c-4a27-a834-1746759c2284 response_code = 200 uri = /vpc-routes
22472024-12-21T08:21:08.362ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
22482024-12-21T08:21:08.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40544 req_id = 2fb246ca-214a-4426-95c5-38f220fa70fa response_code = 204 uri = /eip-gateways
22492024-12-21T08:21:08.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55256
22502024-12-21T08:21:08.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55256 req_id = 12a1750d-c1ea-4c48-aa71-a30c91719f96 response_code = 200 uri = /v2p
22512024-12-21T08:21:08.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40544 req_id = 67a323d7-9cfb-4fd4-914f-87d5c32f44ba response_code = 204 uri = /vpc-routes
22522024-12-21T08:21:08.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65216
22532024-12-21T08:21:08.430ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22542024-12-21T08:21:08.468ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22552024-12-21T08:21:08.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65216 req_id = df0593d7-b449-458c-9f0a-f40c4b4c3394 response_code = 204 uri = /switch-ports
22562024-12-21T08:21:08.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65216 req_id = 28df7f84-9143-4c30-a6f6-d58e8057dfa0 response_code = 200 uri = /network-bootstore-config
22572024-12-21T08:21:08.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58735
22582024-12-21T08:21:08.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58735 req_id = f8a6fb8c-9fdf-46a9-88c8-53c6c1c9d519 response_code = 200 uri = /vpc-routes
22592024-12-21T08:21:08.610ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
22602024-12-21T08:21:08.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58735 req_id = 9ebdd7cc-6df0-430c-9d6c-60054ba6d43d response_code = 204 uri = /eip-gateways
22612024-12-21T08:21:08.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58735 req_id = d060d581-24af-473b-bfd5-2ed587373670 response_code = 204 uri = /vpc-routes
22622024-12-21T08:21:08.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40926
22632024-12-21T08:21:08.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40926 req_id = 8c905c19-8142-4031-bb33-397bf9bd3fe9 response_code = 200 uri = /v2p
22642024-12-21T08:21:08.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43501
22652024-12-21T08:21:08.673ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22662024-12-21T08:21:08.725ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22672024-12-21T08:21:08.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43501 req_id = a78b6373-58d2-4ad2-8e18-29601003d810 response_code = 204 uri = /switch-ports
22682024-12-21T08:21:08.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43501 req_id = 5793a29b-8a55-4ce7-9611-9e674b23d59b response_code = 200 uri = /network-bootstore-config
22692024-12-21T08:21:08.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55588
22702024-12-21T08:21:08.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55588 req_id = 86782e49-8783-479e-8b5d-394e8cb782d2 response_code = 200 uri = /v2p
22712024-12-21T08:21:08.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36073
22722024-12-21T08:21:08.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36073 req_id = b2d3f911-1206-44f2-b3a7-12e5b0ffb7a0 response_code = 200 uri = /vpc-routes
22732024-12-21T08:21:08.959ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
22742024-12-21T08:21:08.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36073 req_id = 73c4378b-fefd-46e9-8c0f-f0fca6c3921f response_code = 204 uri = /eip-gateways
22752024-12-21T08:21:08.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36073 req_id = 895aadf0-5cc7-46aa-83a3-c88ef813eedb response_code = 204 uri = /vpc-routes
22762024-12-21T08:21:08.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45061
22772024-12-21T08:21:08.992ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22782024-12-21T08:21:09.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22792024-12-21T08:21:09.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45061 req_id = 78392fe9-f679-4cfe-a174-07019317f710 response_code = 204 uri = /switch-ports
22802024-12-21T08:21:09.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45061 req_id = cb4b9781-1c7c-43fd-b873-c78ebb8a61da response_code = 200 uri = /network-bootstore-config
22812024-12-21T08:21:13.892ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7149 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 30004a89-81c4-4ac4-9bea-1545d4b50390 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
22822024-12-21T08:21:23.603ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65179
22832024-12-21T08:21:23.603ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65179 req_id = b1c59efa-1a4f-4935-a1e0-600c32c34577 response_code = 200 uri = /baseboard
22842024-12-21T08:21:38.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49244
22852024-12-21T08:21:38.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49244 req_id = 574aa7e5-09b5-4b07-a903-62295a4bc138 response_code = 200 uri = /v2p
22862024-12-21T08:21:38.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64591
22872024-12-21T08:21:38.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64591 req_id = 4fd7a938-d8ad-48b1-840f-4b1da0315655 response_code = 200 uri = /vpc-routes
22882024-12-21T08:21:38.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65425
22892024-12-21T08:21:38.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65425 req_id = 827f5b80-243b-49eb-a590-f88a4c42713b response_code = 200 uri = /vpc-routes
22902024-12-21T08:21:38.610ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
22912024-12-21T08:21:38.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64591 req_id = 374f5821-9569-4813-b2f8-0cad72eb73e8 response_code = 204 uri = /eip-gateways
22922024-12-21T08:21:38.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64591 req_id = f7067b82-935d-440b-a803-52db29116d55 response_code = 204 uri = /vpc-routes
22932024-12-21T08:21:38.638ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
22942024-12-21T08:21:38.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65425 req_id = c621f7d9-78ab-454c-a33a-205fd0562c90 response_code = 204 uri = /eip-gateways
22952024-12-21T08:21:38.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47169
22962024-12-21T08:21:38.640ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22972024-12-21T08:21:38.686ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22982024-12-21T08:21:38.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140431 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47169 req_id = a23e9e1d-52be-44f3-8cc0-e090022fc2e5 response_code = 204 uri = /switch-ports
22992024-12-21T08:21:38.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65425 req_id = eb61bb7f-0c7b-4194-8a43-f6e243acff3d response_code = 204 uri = /vpc-routes
23002024-12-21T08:21:38.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47169 req_id = 8ffbb48f-32b4-44f4-9e75-ec35b355b031 response_code = 200 uri = /network-bootstore-config
23012024-12-21T08:21:38.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34889
23022024-12-21T08:21:38.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34889 req_id = 16131309-bbef-4559-9e27-2b0b6e966e95 response_code = 200 uri = /v2p
23032024-12-21T08:21:38.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52449
23042024-12-21T08:21:38.884ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23052024-12-21T08:21:38.927ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23062024-12-21T08:21:38.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114221 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52449 req_id = 8b9b2e4d-2c7f-4e9d-bc94-bc80e6264477 response_code = 204 uri = /switch-ports
23072024-12-21T08:21:38.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38635
23082024-12-21T08:21:38.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 4b85bc6b-ae7c-4621-994a-d0703e924760 response_code = 200 uri = /vpc-routes
23092024-12-21T08:21:38.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52449 req_id = 3cf38b41-573f-45b9-82ce-61ad0cd9b42c response_code = 200 uri = /network-bootstore-config
23102024-12-21T08:21:39.044ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
23112024-12-21T08:21:39.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 19ef0b6a-3c5e-4e76-8c31-f975a50f22a3 response_code = 204 uri = /eip-gateways
23122024-12-21T08:21:39.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38635 req_id = c7c06999-516d-471b-9a08-13fa83a1af95 response_code = 204 uri = /vpc-routes
23132024-12-21T08:21:39.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58195
23142024-12-21T08:21:39.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58195 req_id = 7d32243f-070d-4c21-b96f-9c4ec69f2dcd response_code = 200 uri = /v2p
23152024-12-21T08:21:39.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56939
23162024-12-21T08:21:39.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23172024-12-21T08:21:39.405ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23182024-12-21T08:21:39.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92587 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56939 req_id = f688d1ab-c9ee-47df-ab73-23fd6a4e5555 response_code = 204 uri = /switch-ports
23192024-12-21T08:21:39.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56939 req_id = d9a55dd6-5c79-4eb4-8322-b3f5764cd8ca response_code = 200 uri = /network-bootstore-config
23202024-12-21T08:21:43.894ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8133 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 5dc852b1-d810-49ad-b627-3268b676c0ca response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
23212024-12-21T08:21:53.634ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49833
23222024-12-21T08:21:53.634ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49833 req_id = e7781e6d-c103-40c1-9f11-e8f7f06692ae response_code = 200 uri = /baseboard
23232024-12-21T08:22:08.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36631
23242024-12-21T08:22:08.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36631 req_id = ab0f7dfd-387a-40c2-a39f-6c19305767be response_code = 200 uri = /vpc-routes
23252024-12-21T08:22:08.401ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
23262024-12-21T08:22:08.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36631 req_id = f8a7d4f0-fb72-415e-b684-fd1cb849daa8 response_code = 204 uri = /eip-gateways
23272024-12-21T08:22:08.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36631 req_id = 9cad9347-1626-4aaf-a7a4-ce9619946dca response_code = 204 uri = /vpc-routes
23282024-12-21T08:22:08.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43332
23292024-12-21T08:22:08.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43332 req_id = 8d1fee32-fd09-4d21-939e-5fca08aba2ea response_code = 200 uri = /v2p
23302024-12-21T08:22:08.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51689
23312024-12-21T08:22:08.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51689 req_id = f3668965-bfe5-4852-9007-cf7704611ca3 response_code = 200 uri = /vpc-routes
23322024-12-21T08:22:08.497ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
23332024-12-21T08:22:08.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51689 req_id = 5a744a4d-f7f7-45d5-980f-aa6410b74a4d response_code = 204 uri = /eip-gateways
23342024-12-21T08:22:08.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51689 req_id = a2fd1908-6eda-41c9-99cf-8b352bfb73ca response_code = 204 uri = /vpc-routes
23352024-12-21T08:22:08.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39774
23362024-12-21T08:22:08.511ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23372024-12-21T08:22:08.545ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23382024-12-21T08:22:08.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91239 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39774 req_id = 85d2ee55-5b4c-4289-9b50-544111302851 response_code = 204 uri = /switch-ports
23392024-12-21T08:22:08.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46035
23402024-12-21T08:22:08.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39774 req_id = 0fe89063-05c6-486d-b6c5-c21532929e5f response_code = 200 uri = /network-bootstore-config
23412024-12-21T08:22:08.603ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23422024-12-21T08:22:08.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62245
23432024-12-21T08:22:08.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62245 req_id = 356cfc9c-a48c-4c68-9a77-03f809ce7332 response_code = 200 uri = /v2p
23442024-12-21T08:22:08.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23452024-12-21T08:22:08.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46035 req_id = 274ce19b-448c-4b38-bc31-e6dfec0d1bc5 response_code = 204 uri = /switch-ports
23462024-12-21T08:22:08.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46035 req_id = d27a012e-f778-4128-8ace-c881ebf40790 response_code = 200 uri = /network-bootstore-config
23472024-12-21T08:22:08.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42273
23482024-12-21T08:22:08.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42273 req_id = f7104183-5632-442e-8579-960ec2512ae0 response_code = 200 uri = /vpc-routes
23492024-12-21T08:22:08.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
23502024-12-21T08:22:08.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42273 req_id = bc37ee32-b5f0-44c3-8786-58ce9b45f2c2 response_code = 204 uri = /eip-gateways
23512024-12-21T08:22:08.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42273 req_id = d6061f3c-4c3d-4645-b859-c2b5c041854e response_code = 204 uri = /vpc-routes
23522024-12-21T08:22:08.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48873
23532024-12-21T08:22:08.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23542024-12-21T08:22:09.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23552024-12-21T08:22:09.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102646 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48873 req_id = 8f625a12-3411-48b2-986a-7bfebcf5c22e response_code = 204 uri = /switch-ports
23562024-12-21T08:22:09.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60670
23572024-12-21T08:22:09.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60670 req_id = 4606af82-b204-4108-8cec-a1a6ad2dc0ba response_code = 200 uri = /v2p
23582024-12-21T08:22:09.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48873 req_id = 642de14b-e4b4-4558-910c-a8fd221c09bb response_code = 200 uri = /network-bootstore-config
23592024-12-21T08:22:13.894ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7163 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 4136d302-4d22-471e-9265-8df25c7fd078 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
23602024-12-21T08:22:23.667ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63570
23612024-12-21T08:22:23.667ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63570 req_id = 25d494de-e32c-4d6a-a950-66aeaf7b3426 response_code = 200 uri = /baseboard
23622024-12-21T08:22:30.566ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23632024-12-21T08:22:30.566ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23642024-12-21T08:22:30.598ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1982, tv_nsec: 300564579 } time_to_next_cleanup = 599.99999815s
23652024-12-21T08:22:38.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37475
23662024-12-21T08:22:38.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37475 req_id = 334c6653-bece-400d-9aad-7823758845f3 response_code = 200 uri = /vpc-routes
23672024-12-21T08:22:38.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51831
23682024-12-21T08:22:38.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51831 req_id = 52e5ccc1-582e-4a81-965a-e02a2c882828 response_code = 200 uri = /vpc-routes
23692024-12-21T08:22:38.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
23702024-12-21T08:22:38.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37475 req_id = 919eb42a-ad2c-4fa3-b614-62180283a533 response_code = 204 uri = /eip-gateways
23712024-12-21T08:22:38.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37475 req_id = c96d3f5f-7086-46c5-8fd6-e9d5faf7e00c response_code = 204 uri = /vpc-routes
23722024-12-21T08:22:38.589ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
23732024-12-21T08:22:38.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51831 req_id = 11d90190-dfbb-47bd-ae9c-177ba630f9ac response_code = 204 uri = /eip-gateways
23742024-12-21T08:22:38.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51831 req_id = 6953b143-01fb-408f-935c-4b625a9d3fc1 response_code = 204 uri = /vpc-routes
23752024-12-21T08:22:38.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49847
23762024-12-21T08:22:38.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23772024-12-21T08:22:38.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23782024-12-21T08:22:38.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138537 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49847 req_id = cb780a6a-3686-4a08-aa0e-4608e989c74c response_code = 204 uri = /switch-ports
23792024-12-21T08:22:38.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51362
23802024-12-21T08:22:38.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51362 req_id = 671c5d5e-ce51-4070-b91b-e7c3822f6943 response_code = 200 uri = /v2p
23812024-12-21T08:22:38.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49847 req_id = 9a913528-2bcb-4f15-9c3f-54f0a7600091 response_code = 200 uri = /network-bootstore-config
23822024-12-21T08:22:38.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50312
23832024-12-21T08:22:38.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50312 req_id = afbc208d-1aa7-4932-a9ee-56454432864e response_code = 200 uri = /v2p
23842024-12-21T08:22:38.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60435
23852024-12-21T08:22:38.874ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23862024-12-21T08:22:38.910ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23872024-12-21T08:22:38.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90921 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60435 req_id = 77bf8adc-e154-4f46-9e70-54867c9180ed response_code = 204 uri = /switch-ports
23882024-12-21T08:22:38.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60435 req_id = 10d12178-daaa-4bbc-80e5-5f4aed69a584 response_code = 200 uri = /network-bootstore-config
23892024-12-21T08:22:39.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47822
23902024-12-21T08:22:39.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47822 req_id = 00e3cbe4-3c8c-4a37-8537-3d0c773b1d95 response_code = 200 uri = /vpc-routes
23912024-12-21T08:22:39.111ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
23922024-12-21T08:22:39.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47822 req_id = 8cb9c487-0d6b-4c58-8b61-c17f54c587cb response_code = 204 uri = /eip-gateways
23932024-12-21T08:22:39.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47822 req_id = f0a72ae4-d2c1-4ed9-a628-96271a177353 response_code = 204 uri = /vpc-routes
23942024-12-21T08:22:39.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53141
23952024-12-21T08:22:39.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53141 req_id = 1b710fec-8227-46c6-bb15-5a72b96ad885 response_code = 200 uri = /v2p
23962024-12-21T08:22:39.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42302
23972024-12-21T08:22:39.192ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23982024-12-21T08:22:39.230ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23992024-12-21T08:22:39.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89930 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42302 req_id = 9f9fbb7f-72d5-4a98-92e8-95df24a356f7 response_code = 204 uri = /switch-ports
24002024-12-21T08:22:39.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42302 req_id = 65e9bbc9-1e21-40ef-9cb4-02290cbcfcd4 response_code = 200 uri = /network-bootstore-config
24012024-12-21T08:22:43.894ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7124 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 93d8ff94-5e3f-4765-a0dc-4d481b5a40df response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
24022024-12-21T08:22:44.836ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24032024-12-21T08:22:53.702ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36950
24042024-12-21T08:22:53.702ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36950 req_id = c99656f1-6ada-4a4c-8e64-e6c68bb22ade response_code = 200 uri = /baseboard
24052024-12-21T08:23:08.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55017
24062024-12-21T08:23:08.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55017 req_id = 9eb8ee2c-212e-4e2f-bd91-2ae5771d64e2 response_code = 200 uri = /vpc-routes
24072024-12-21T08:23:08.349ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
24082024-12-21T08:23:08.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55017 req_id = 0b0a2161-d2e4-41c6-837f-eab57cb34637 response_code = 204 uri = /eip-gateways
24092024-12-21T08:23:08.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55017 req_id = b0793cb5-b401-4004-a141-66903ae69317 response_code = 204 uri = /vpc-routes
24102024-12-21T08:23:08.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45338
24112024-12-21T08:23:08.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45338 req_id = 70f74438-86a4-4ba9-a11b-9294a689be85 response_code = 200 uri = /vpc-routes
24122024-12-21T08:23:08.492ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
24132024-12-21T08:23:08.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45338 req_id = dde140f4-5c04-4f89-85bc-74f36b619614 response_code = 204 uri = /eip-gateways
24142024-12-21T08:23:08.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44651
24152024-12-21T08:23:08.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44651 req_id = 8ac11edb-6bde-4c3b-935c-110919c48948 response_code = 200 uri = /v2p
24162024-12-21T08:23:08.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45338 req_id = 0fbf8ddc-7590-49c4-9cef-da76251f797f response_code = 204 uri = /vpc-routes
24172024-12-21T08:23:08.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37134
24182024-12-21T08:23:08.533ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24192024-12-21T08:23:08.570ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24202024-12-21T08:23:08.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94699 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37134 req_id = 9416fe5a-8a21-425c-861d-586bb385dce5 response_code = 204 uri = /switch-ports
24212024-12-21T08:23:08.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49558
24222024-12-21T08:23:08.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39544
24232024-12-21T08:23:08.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37134 req_id = 7d3e496f-b908-42a3-b1e2-a2c1a91a30a6 response_code = 200 uri = /network-bootstore-config
24242024-12-21T08:23:08.628ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24252024-12-21T08:23:08.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39544 req_id = dd65aec6-fd83-43ec-a627-45c540f00e65 response_code = 200 uri = /v2p
24262024-12-21T08:23:08.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24272024-12-21T08:23:08.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114992 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49558 req_id = 1dc91aa6-3319-4a01-a5c1-268b9a4f2706 response_code = 204 uri = /switch-ports
24282024-12-21T08:23:08.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49558 req_id = b7c8d03b-7098-4a00-be2d-4b54082acdd5 response_code = 200 uri = /network-bootstore-config
24292024-12-21T08:23:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45744
24302024-12-21T08:23:08.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45744 req_id = 87d2b8c9-5342-45bd-a6ec-75e0a6ebe092 response_code = 200 uri = /vpc-routes
24312024-12-21T08:23:08.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51136
24322024-12-21T08:23:08.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51136 req_id = 4188f39a-c014-468b-b851-9eea72e375d0 response_code = 200 uri = /v2p
24332024-12-21T08:23:08.968ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
24342024-12-21T08:23:08.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45744 req_id = d2c8ab0b-d7b0-49fd-8869-309bfa2ad3d6 response_code = 204 uri = /eip-gateways
24352024-12-21T08:23:08.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45744 req_id = 0d4f8a14-1cd1-486b-a0c5-e026e8bd5f47 response_code = 204 uri = /vpc-routes
24362024-12-21T08:23:09.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33295
24372024-12-21T08:23:09.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24382024-12-21T08:23:09.068ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24392024-12-21T08:23:09.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33295 req_id = 8762f666-5c2b-4123-949f-48bf3193c161 response_code = 204 uri = /switch-ports
24402024-12-21T08:23:09.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33295 req_id = 1939caaf-e2d1-43f5-b56a-d8baf0fcc774 response_code = 200 uri = /network-bootstore-config
24412024-12-21T08:23:13.894ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7758 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = dda60c6a-e736-4e5b-8a17-e2430bb816d8 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
24422024-12-21T08:23:23.736ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43137
24432024-12-21T08:23:23.736ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43137 req_id = 21f2dca3-6a61-4790-8dd3-c87686c5ebd1 response_code = 200 uri = /baseboard
24442024-12-21T08:23:38.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48524
24452024-12-21T08:23:38.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48524 req_id = 3cd8d312-927e-4f28-a2d0-e571a3fa5929 response_code = 200 uri = /vpc-routes
24462024-12-21T08:23:38.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
24472024-12-21T08:23:38.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48524 req_id = a2b57ece-b7ab-4aab-b8a4-ee6fd5cc4739 response_code = 204 uri = /eip-gateways
24482024-12-21T08:23:38.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48524 req_id = d4a15e48-4a2d-4e29-bd6e-b309dd5067af response_code = 204 uri = /vpc-routes
24492024-12-21T08:23:38.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52147
24502024-12-21T08:23:38.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52147 req_id = b16299ec-e19e-4c22-9823-768de1b9ee72 response_code = 200 uri = /v2p
24512024-12-21T08:23:38.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61219
24522024-12-21T08:23:38.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61219 req_id = b886cfcb-8c3a-40a7-9c8f-fe05e3611787 response_code = 200 uri = /v2p
24532024-12-21T08:23:38.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61229
24542024-12-21T08:23:38.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24552024-12-21T08:23:38.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24562024-12-21T08:23:38.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61229 req_id = 45358eaf-cc3a-4aa4-aa00-71d4ff179966 response_code = 204 uri = /switch-ports
24572024-12-21T08:23:38.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61229 req_id = 7804a957-f43e-423d-93b1-40bcd710416d response_code = 200 uri = /network-bootstore-config
24582024-12-21T08:23:38.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62721
24592024-12-21T08:23:38.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62721 req_id = d5f8945f-9e31-4409-bc52-638e62d21e4f response_code = 200 uri = /vpc-routes
24602024-12-21T08:23:38.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57267
24612024-12-21T08:23:38.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57267 req_id = 5e0a8359-7a42-4711-98e8-388a9aed45e3 response_code = 200 uri = /v2p
24622024-12-21T08:23:38.906ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
24632024-12-21T08:23:38.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62721 req_id = 2a252601-afdd-4185-b81c-6d020fecafd8 response_code = 204 uri = /eip-gateways
24642024-12-21T08:23:38.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62721 req_id = f7487129-54e8-4fcc-8f10-63a922f31742 response_code = 204 uri = /vpc-routes
24652024-12-21T08:23:38.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33746
24662024-12-21T08:23:38.938ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24672024-12-21T08:23:38.984ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24682024-12-21T08:23:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33746 req_id = c19cca88-9714-4277-a4ee-f4a2b3dbb4c8 response_code = 204 uri = /switch-ports
24692024-12-21T08:23:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33746 req_id = 538de747-bfbd-4727-84e7-340322453ddc response_code = 200 uri = /network-bootstore-config
24702024-12-21T08:23:39.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39035
24712024-12-21T08:23:39.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39035 req_id = b5585e49-dc60-4ae5-a016-0f95429cc339 response_code = 200 uri = /vpc-routes
24722024-12-21T08:23:39.200ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
24732024-12-21T08:23:39.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39035 req_id = 94389424-3975-46e1-ad73-e728c8df8d67 response_code = 204 uri = /eip-gateways
24742024-12-21T08:23:39.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39035 req_id = 174f3a1d-a549-463a-bba6-2d04136700d8 response_code = 204 uri = /vpc-routes
24752024-12-21T08:23:39.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43064
24762024-12-21T08:23:39.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24772024-12-21T08:23:39.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24782024-12-21T08:23:39.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43064 req_id = a3a6edc0-fb2e-4753-b186-86ffdb54a4fa response_code = 204 uri = /switch-ports
24792024-12-21T08:23:39.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43064 req_id = afa14f35-de48-4b8f-80d9-25101e7836d2 response_code = 200 uri = /network-bootstore-config
24802024-12-21T08:23:43.894ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7299 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 98f29689-0002-491d-9323-bdc13ff1a317 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
24812024-12-21T08:23:53.772ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64324
24822024-12-21T08:23:53.772ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64324 req_id = dd1e07ec-f03b-4020-a887-9e0c945d5ded response_code = 200 uri = /baseboard
24832024-12-21T08:24:08.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46922
24842024-12-21T08:24:08.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46922 req_id = 0836041a-318d-4e90-852d-9a06c89e3d4a response_code = 200 uri = /v2p
24852024-12-21T08:24:08.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53439
24862024-12-21T08:24:08.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53439 req_id = c5ed6c58-3147-4b60-8a55-f50a095f2fac response_code = 200 uri = /vpc-routes
24872024-12-21T08:24:08.445ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
24882024-12-21T08:24:08.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53439 req_id = 4e2b0bdc-c6f8-4fff-9354-e88584eeef40 response_code = 204 uri = /eip-gateways
24892024-12-21T08:24:08.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53439 req_id = b78766a7-7f53-49f9-b420-afe8b20acfe5 response_code = 204 uri = /vpc-routes
24902024-12-21T08:24:08.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54311
24912024-12-21T08:24:08.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54311 req_id = 6b46e00d-038a-41ff-8827-7457108147e6 response_code = 200 uri = /vpc-routes
24922024-12-21T08:24:08.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38563
24932024-12-21T08:24:08.523ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24942024-12-21T08:24:08.564ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24952024-12-21T08:24:08.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108498 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38563 req_id = 57429f74-060d-479a-90d6-44e35a391c0c response_code = 204 uri = /switch-ports
24962024-12-21T08:24:08.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51507
24972024-12-21T08:24:08.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
24982024-12-21T08:24:08.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54311 req_id = 60ff99da-b114-463c-9fb9-178feb36ce06 response_code = 204 uri = /eip-gateways
24992024-12-21T08:24:08.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38563 req_id = 82aa84aa-b04c-4082-b4d5-6f8f7be45794 response_code = 200 uri = /network-bootstore-config
25002024-12-21T08:24:08.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51507 req_id = 02d5bb68-c93b-4041-95a5-9866486903f4 response_code = 200 uri = /v2p
25012024-12-21T08:24:08.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54311 req_id = 96a2facd-9adf-4340-96e7-b52a7c1c066a response_code = 204 uri = /vpc-routes
25022024-12-21T08:24:08.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44409
25032024-12-21T08:24:08.645ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25042024-12-21T08:24:08.700ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25052024-12-21T08:24:08.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140234 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44409 req_id = ce73a2b8-a9eb-4562-9469-96b2aed295d2 response_code = 204 uri = /switch-ports
25062024-12-21T08:24:08.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44409 req_id = c223b570-5329-405a-923a-dff17dfc4000 response_code = 200 uri = /network-bootstore-config
25072024-12-21T08:24:08.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64809
25082024-12-21T08:24:08.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64809 req_id = e048e955-ae82-460a-bfc0-40fbf5e4a3b7 response_code = 200 uri = /vpc-routes
25092024-12-21T08:24:08.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
25102024-12-21T08:24:08.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64809 req_id = 918beca8-85ab-4a05-b227-4a5a9c605253 response_code = 204 uri = /eip-gateways
25112024-12-21T08:24:08.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64809 req_id = 8c517638-da99-458f-87da-b71ce11824f3 response_code = 204 uri = /vpc-routes
25122024-12-21T08:24:08.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52559
25132024-12-21T08:24:08.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52559 req_id = 2bd10bc8-a183-47ca-926b-015531170d9b response_code = 200 uri = /v2p
25142024-12-21T08:24:09.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53147
25152024-12-21T08:24:09.050ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25162024-12-21T08:24:09.087ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25172024-12-21T08:24:09.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94899 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53147 req_id = d2d728a5-7fad-41d4-a9f4-00bff2ce2194 response_code = 204 uri = /switch-ports
25182024-12-21T08:24:09.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53147 req_id = c32ea79f-f811-46d1-8f9c-daa9b01f7f31 response_code = 200 uri = /network-bootstore-config
25192024-12-21T08:24:13.894ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7446 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = da5b5907-920e-4e08-9c38-72330bebc324 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
25202024-12-21T08:24:23.805ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45872
25212024-12-21T08:24:23.805ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45872 req_id = c6cb8112-2cfa-4021-9937-f9257ba84404 response_code = 200 uri = /baseboard
25222024-12-21T08:24:38.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61157
25232024-12-21T08:24:38.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61157 req_id = 7033b18d-ea60-403d-9481-e1d578e0540d response_code = 200 uri = /vpc-routes
25242024-12-21T08:24:38.562ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
25252024-12-21T08:24:38.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61157 req_id = 92f5274b-5113-45c2-99a0-ac28e9582543 response_code = 204 uri = /eip-gateways
25262024-12-21T08:24:38.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33035
25272024-12-21T08:24:38.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33035 req_id = f61cc083-e323-4a7b-aead-bed3ae2fb059 response_code = 200 uri = /vpc-routes
25282024-12-21T08:24:38.673ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
25292024-12-21T08:24:38.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33035 req_id = b25d3a04-6481-4e07-a139-264a3455f207 response_code = 204 uri = /eip-gateways
25302024-12-21T08:24:38.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33035 req_id = baf3d799-c115-4b14-b85c-7f303270900a response_code = 204 uri = /vpc-routes
25312024-12-21T08:24:38.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39857
25322024-12-21T08:24:38.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25332024-12-21T08:24:38.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25342024-12-21T08:24:38.755ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:177
25352024-12-21T08:24:38.756ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:177
25362024-12-21T08:24:38.773ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25372024-12-21T08:24:38.773ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9
25382024-12-21T08:24:38.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62029
25392024-12-21T08:24:38.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57511
25402024-12-21T08:24:38.801ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25412024-12-21T08:24:38.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 464 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62029 req_id = 4b720504-d652-49ed-91f2-874b20e736f0 response_code = 200 uri = /v2p
25422024-12-21T08:24:38.801ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25432024-12-21T08:24:38.802ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:177
25442024-12-21T08:24:38.802ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:177
25452024-12-21T08:24:38.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 467 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61157 req_id = 00956750-72fc-4f14-b93a-17bc1772ae4b response_code = 204 uri = /vpc-routes
25462024-12-21T08:24:38.814ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25472024-12-21T08:24:38.814ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf
25482024-12-21T08:24:38.839ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25492024-12-21T08:24:38.839ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9
25502024-12-21T08:24:38.859ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25512024-12-21T08:24:38.859ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f6f464f-c123-4470-96c3-74700df96380
25522024-12-21T08:24:38.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45227
25532024-12-21T08:24:38.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45227 req_id = 9a4bd018-b453-4b4f-a881-eb07814de9ac response_code = 200 uri = /v2p
25542024-12-21T08:24:38.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58109
25552024-12-21T08:24:38.877ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25562024-12-21T08:24:38.882ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25572024-12-21T08:24:38.883ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf
25582024-12-21T08:24:38.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51909
25592024-12-21T08:24:38.904ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25602024-12-21T08:24:38.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e
25612024-12-21T08:24:38.920ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25622024-12-21T08:24:38.920ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f6f464f-c123-4470-96c3-74700df96380
25632024-12-21T08:24:38.929ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25642024-12-21T08:24:38.951ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25652024-12-21T08:24:38.951ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e
25662024-12-21T08:24:38.970ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25672024-12-21T08:24:38.970ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12
25682024-12-21T08:24:38.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25692024-12-21T08:24:38.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12
25702024-12-21T08:24:39.004ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25712024-12-21T08:24:39.004ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c782891-c1e8-4191-bfea-a3d07d39b468
25722024-12-21T08:24:39.009ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25732024-12-21T08:24:39.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132964 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58109 req_id = cba18a6d-883d-43b0-834b-658cc3cdab13 response_code = 204 uri = /switch-ports
25742024-12-21T08:24:39.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47740
25752024-12-21T08:24:39.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 513 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58109 req_id = b7ab163a-0adb-4239-8001-9bf4c4d2947c response_code = 200 uri = /network-bootstore-config
25762024-12-21T08:24:39.015ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25772024-12-21T08:24:39.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25782024-12-21T08:24:39.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25792024-12-21T08:24:39.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25802024-12-21T08:24:39.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25812024-12-21T08:24:39.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25822024-12-21T08:24:39.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25832024-12-21T08:24:39.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 932 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47740 req_id = c330b03a-6cb2-4dca-9f91-8febea5f3ff1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25842024-12-21T08:24:39.032ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25852024-12-21T08:24:39.032ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c782891-c1e8-4191-bfea-a3d07d39b468
25862024-12-21T08:24:39.049ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25872024-12-21T08:24:39.049ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a
25882024-12-21T08:24:39.059ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25892024-12-21T08:24:39.076ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25902024-12-21T08:24:39.076ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb
25912024-12-21T08:24:39.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45914
25922024-12-21T08:24:39.082ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25932024-12-21T08:24:39.082ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25942024-12-21T08:24:39.082ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25952024-12-21T08:24:39.082ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25962024-12-21T08:24:39.082ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25972024-12-21T08:24:39.082ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25982024-12-21T08:24:39.082ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25992024-12-21T08:24:39.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 724 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45914 req_id = 0bf55430-4783-4812-ba59-337f6eba83ba response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26002024-12-21T08:24:39.092ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26012024-12-21T08:24:39.092ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a
26022024-12-21T08:24:39.107ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26032024-12-21T08:24:39.107ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f
26042024-12-21T08:24:39.122ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26052024-12-21T08:24:39.122ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb
26062024-12-21T08:24:39.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231594 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51909 req_id = 627af7c8-5f15-465c-b5c2-17defd538342 response_code = 204 uri = /switch-ports
26072024-12-21T08:24:39.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51909 req_id = c26b6990-f45a-4dcf-9f7a-c24c45ac3fcd response_code = 200 uri = /network-bootstore-config
26082024-12-21T08:24:39.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48279
26092024-12-21T08:24:39.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48279 req_id = 03754a6c-71a2-4196-94c7-b65e8dc1b781 response_code = 200 uri = /vpc-routes
26102024-12-21T08:24:39.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 384376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39857 req_id = fff5fa21-fdcd-45c4-9532-c31a7a8f195f response_code = 200 uri = /inventory
26112024-12-21T08:24:39.146ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26122024-12-21T08:24:39.146ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f
26132024-12-21T08:24:39.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358479 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57511 req_id = 4a3d86f7-5a82-4ca3-a766-8b4255410ddd response_code = 200 uri = /inventory
26142024-12-21T08:24:39.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60644
26152024-12-21T08:24:39.367ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 979d9af5-65b9-480d-872d-a74a34182b22, kind: Service { id: 67643b43-461d-4a9a-b2c9-50310796834b }, name: Name("external-dns-67643b43-461d-4a9a-b2c9-50310796834b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa928a40-cea7-40b2-a842-d4d032975056, kind: Service { id: f32db93d-bd49-40af-b49e-21286ae1d662 }, name: Name("external-dns-f32db93d-bd49-40af-b49e-21286ae1d662"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 104])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b0737f5-e458-4004-b381-eb0eda71f0f4, kind: Service { id: ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052 }, name: Name("nexus-ec4ba7ff-b2cc-46dd-a51b-5d3b53dd3052"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8beb9b46-fa75-4441-a42d-daaa3640fd41, kind: Service { id: 79540a52-e06e-42bc-84fa-4d123ac6fb47 }, name: Name("nexus-79540a52-e06e-42bc-84fa-4d123ac6fb47"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e8f1cea-28f0-492f-96a4-faa1133204f8, kind: Service { id: 75b64dc8-5e97-4be1-9e6c-ea78c81122ba }, name: Name("nexus-75b64dc8-5e97-4be1-9e6c-ea78c81122ba"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26162024-12-21T08:24:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26172024-12-21T08:24:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26182024-12-21T08:24:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26192024-12-21T08:24:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26202024-12-21T08:24:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26212024-12-21T08:24:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26222024-12-21T08:24:39.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 430 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60644 req_id = 0538512f-0275-46d7-8640-699d70e97374 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26232024-12-21T08:24:39.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45538
26242024-12-21T08:24:39.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45538 req_id = 262a3e4e-126b-4b2c-b6bd-5684b76956a6 response_code = 200 uri = /v2p
26252024-12-21T08:24:39.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
26262024-12-21T08:24:39.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48279 req_id = a1b78918-d414-4ddf-b0f1-bcf23187b8f3 response_code = 204 uri = /eip-gateways
26272024-12-21T08:24:39.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48279 req_id = 0c388175-1080-4385-984c-6a0f25269179 response_code = 204 uri = /vpc-routes
26282024-12-21T08:24:39.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43325
26292024-12-21T08:24:39.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26302024-12-21T08:24:39.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26312024-12-21T08:24:39.474ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/config/omicron-zones.json file = common/src/ledger.rs:177
26322024-12-21T08:24:39.474ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/config/omicron-zones.json file = common/src/ledger.rs:177
26332024-12-21T08:24:39.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60212
26342024-12-21T08:24:39.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26352024-12-21T08:24:39.491ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3caa59cc-979c-4da7-a824-aa5e8414d2f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26362024-12-21T08:24:39.491ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3caa59cc-979c-4da7-a824-aa5e8414d2f9
26372024-12-21T08:24:39.520ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 29c1565e-7974-4bcb-973b-db1b549c6ecf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26382024-12-21T08:24:39.521ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_29c1565e-7974-4bcb-973b-db1b549c6ecf
26392024-12-21T08:24:39.526ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26402024-12-21T08:24:39.546ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f6f464f-c123-4470-96c3-74700df96380 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26412024-12-21T08:24:39.546ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f6f464f-c123-4470-96c3-74700df96380
26422024-12-21T08:24:39.570ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24878837-3bb1-4d27-8c56-15f8ac2e680e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26432024-12-21T08:24:39.570ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24878837-3bb1-4d27-8c56-15f8ac2e680e
26442024-12-21T08:24:39.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60212 req_id = cd79e5a4-83c8-4ac8-82d7-21994355b873 response_code = 204 uri = /switch-ports
26452024-12-21T08:24:39.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60212 req_id = 4174ed23-4b8d-409e-af33-4da6b3dfadc5 response_code = 200 uri = /network-bootstore-config
26462024-12-21T08:24:39.593ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e50c301-7543-4c86-ba5a-3cc2a22c5b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26472024-12-21T08:24:39.593ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0e50c301-7543-4c86-ba5a-3cc2a22c5b12
26482024-12-21T08:24:39.615ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c782891-c1e8-4191-bfea-a3d07d39b468 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26492024-12-21T08:24:39.615ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c782891-c1e8-4191-bfea-a3d07d39b468
26502024-12-21T08:24:39.636ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26393665-bd5a-4f9d-bdcf-a6c02b4ac68a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26512024-12-21T08:24:39.637ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_26393665-bd5a-4f9d-bdcf-a6c02b4ac68a
26522024-12-21T08:24:39.656ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43b4495f-efdc-40ca-94f0-9afc6b7215eb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26532024-12-21T08:24:39.656ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_43b4495f-efdc-40ca-94f0-9afc6b7215eb
26542024-12-21T08:24:39.678ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7152a0da-15e8-4d64-8b5a-329e0a03fc6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26552024-12-21T08:24:39.678ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7152a0da-15e8-4d64-8b5a-329e0a03fc6f
26562024-12-21T08:24:39.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43325 req_id = 452da134-18cd-4ae5-94d0-e70c5ad73884 response_code = 200 uri = /inventory
26572024-12-21T08:24:43.894ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7247 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = 4e8e3b50-3706-44fa-a065-7c6c1464acea response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
26582024-12-21T08:24:53.837ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56889
26592024-12-21T08:24:53.837ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56889 req_id = 9c9e8a5a-953e-4fe0-ac2b-333976fe969a response_code = 200 uri = /baseboard
26602024-12-21T08:25:08.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53883
26612024-12-21T08:25:08.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53883 req_id = b91c1509-977f-4961-ae6e-290ce9aa0531 response_code = 200 uri = /vpc-routes
26622024-12-21T08:25:08.451ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
26632024-12-21T08:25:08.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53883 req_id = 37223bd0-96c9-461e-a48f-df28b727ce5b response_code = 204 uri = /eip-gateways
26642024-12-21T08:25:08.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53883 req_id = 70b8b912-8109-4c45-94a4-07f3940b3e58 response_code = 204 uri = /vpc-routes
26652024-12-21T08:25:08.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39753
26662024-12-21T08:25:08.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39753 req_id = 2a2cbd08-7e71-4b34-bba4-9a40aeb695e2 response_code = 200 uri = /v2p
26672024-12-21T08:25:08.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36054
26682024-12-21T08:25:08.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36054 req_id = 9683473e-a618-4a74-8d6f-06b10e92e83e response_code = 200 uri = /vpc-routes
26692024-12-21T08:25:08.476ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
26702024-12-21T08:25:08.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36054 req_id = 086a542b-ec32-4d01-9712-8129ab3846de response_code = 204 uri = /eip-gateways
26712024-12-21T08:25:08.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36054 req_id = eedb0587-5f57-41e1-ac94-346dfc5876f8 response_code = 204 uri = /vpc-routes
26722024-12-21T08:25:08.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45935
26732024-12-21T08:25:08.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26742024-12-21T08:25:08.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26752024-12-21T08:25:08.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103310 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45935 req_id = 7ab33a14-a06a-411b-85bd-06adbe3f3f4f response_code = 204 uri = /switch-ports
26762024-12-21T08:25:08.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38090
26772024-12-21T08:25:08.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56206
26782024-12-21T08:25:08.648ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26792024-12-21T08:25:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38090 req_id = 09a79320-5aef-4710-9b3a-40820e434392 response_code = 200 uri = /v2p
26802024-12-21T08:25:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3832 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45935 req_id = aff18471-f143-46cf-be6f-f58d57d75907 response_code = 200 uri = /network-bootstore-config
26812024-12-21T08:25:08.691ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26822024-12-21T08:25:08.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117458 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56206 req_id = d32c0f88-ecc1-4cc3-be46-b3e2645ed84d response_code = 204 uri = /switch-ports
26832024-12-21T08:25:08.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56206 req_id = a3fe88e6-2e51-4bdc-a0dc-d3eb2aa2a52c response_code = 200 uri = /network-bootstore-config
26842024-12-21T08:25:08.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37465
26852024-12-21T08:25:08.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37465 req_id = 094b0150-a2e5-430b-a467-e12b961c55ea response_code = 200 uri = /v2p
26862024-12-21T08:25:09.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50373
26872024-12-21T08:25:09.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50373 req_id = 3e251cf9-8dbd-4198-9f14-e6299184004a response_code = 200 uri = /vpc-routes
26882024-12-21T08:25:09.027ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
26892024-12-21T08:25:09.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50373 req_id = 485f7e3b-b0e1-4804-b307-433f4a4b6b0b response_code = 204 uri = /eip-gateways
26902024-12-21T08:25:09.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50373 req_id = c3beceb2-6e31-4883-a729-f21c5d15d171 response_code = 204 uri = /vpc-routes
26912024-12-21T08:25:09.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46065
26922024-12-21T08:25:09.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26932024-12-21T08:25:09.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26942024-12-21T08:25:09.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46065 req_id = 4e2b6a83-8709-44b6-843a-397b1257b6b2 response_code = 204 uri = /switch-ports
26952024-12-21T08:25:09.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46065 req_id = ebe643f3-115b-4fb1-9cdc-aa43ecee586b response_code = 200 uri = /network-bootstore-config
26962024-12-21T08:25:13.895ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7787 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = c75cee4e-28fb-4269-8789-b4438dbe44b1 response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
26972024-12-21T08:25:23.870ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41547
26982024-12-21T08:25:23.870ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41547 req_id = 807617e8-7363-4810-bb38-7ac1d3ceeeb0 response_code = 200 uri = /baseboard
26992024-12-21T08:25:38.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32854
27002024-12-21T08:25:38.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32854 req_id = 5e4dd7e9-8da3-439e-bcec-7ac8f34ccbe4 response_code = 200 uri = /v2p
27012024-12-21T08:25:38.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52460
27022024-12-21T08:25:38.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52460 req_id = 80e69f2d-7010-49de-8f17-b3e876819aa3 response_code = 200 uri = /vpc-routes
27032024-12-21T08:25:38.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50080
27042024-12-21T08:25:38.657ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27052024-12-21T08:25:38.703ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27062024-12-21T08:25:38.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50080 req_id = fc6c6ad7-3fec-4eca-ae18-054b70b03a2f response_code = 204 uri = /switch-ports
27072024-12-21T08:25:38.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56705
27082024-12-21T08:25:38.803ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
27092024-12-21T08:25:38.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52460 req_id = 888eb8b0-cd77-4d15-80e7-40f096ae618c response_code = 204 uri = /eip-gateways
27102024-12-21T08:25:38.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56705 req_id = 244ff0d1-407b-4d0a-bf03-7dd1362e5b02 response_code = 200 uri = /vpc-routes
27112024-12-21T08:25:38.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50080 req_id = 0960ce6c-690d-4601-9061-dd3595957fe8 response_code = 200 uri = /network-bootstore-config
27122024-12-21T08:25:38.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52460 req_id = 85e95612-b3b0-4dfd-88c4-a8cb7e53994a response_code = 204 uri = /vpc-routes
27132024-12-21T08:25:38.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40460
27142024-12-21T08:25:38.814ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27152024-12-21T08:25:38.854ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27162024-12-21T08:25:38.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103108 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40460 req_id = d3d38b37-4009-4b13-ba4b-9cdd7334a0ff response_code = 204 uri = /switch-ports
27172024-12-21T08:25:38.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33290
27182024-12-21T08:25:38.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52691
27192024-12-21T08:25:38.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 754 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33290 req_id = 2e81077b-9765-4492-a4a2-68ffb7c0ce3e response_code = 200 uri = /v2p
27202024-12-21T08:25:38.923ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
27212024-12-21T08:25:38.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5446 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56705 req_id = cf469382-75aa-4623-a217-cf1b614ebe40 response_code = 204 uri = /eip-gateways
27222024-12-21T08:25:38.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5448 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40460 req_id = 2b5b695b-93ac-473f-80bb-0e4f83fecf6b response_code = 200 uri = /network-bootstore-config
27232024-12-21T08:25:38.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52691 req_id = 27749313-7a74-4927-b3eb-9f479c3e34c5 response_code = 200 uri = /vpc-routes
27242024-12-21T08:25:38.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56705 req_id = c6fb92cc-c3d0-4da9-b7e5-6bbfe515cb7d response_code = 204 uri = /vpc-routes
27252024-12-21T08:25:38.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
27262024-12-21T08:25:38.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52691 req_id = c9f47a98-a90a-4666-94ed-2714750d2034 response_code = 204 uri = /eip-gateways
27272024-12-21T08:25:38.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52691 req_id = a5783d21-9719-46c3-8c15-338225d79fe0 response_code = 204 uri = /vpc-routes
27282024-12-21T08:25:39.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46807
27292024-12-21T08:25:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46807 req_id = 82685521-945b-4be2-8f62-9e8a9b0a2cf7 response_code = 200 uri = /v2p
27302024-12-21T08:25:39.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59685
27312024-12-21T08:25:39.222ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27322024-12-21T08:25:39.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27332024-12-21T08:25:39.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99720 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59685 req_id = 0c1c31eb-6fc1-4a2e-969f-d8d36ec2039d response_code = 204 uri = /switch-ports
27342024-12-21T08:25:39.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59685 req_id = ed46f7c9-a677-4eae-9605-684be71e2cfb response_code = 200 uri = /network-bootstore-config
27352024-12-21T08:25:43.895ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7109 local_addr = [fd00:1122:3344:101::1]:62812 method = GET remote_addr = [fd00:1122:3344:101::d]:42396 req_id = f6b5a04d-8565-48af-b06e-dbe31d9804df response_code = 200 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 uri = /118e564e-0bce-46c7-b69d-5b3dee81ed48
27362024-12-21T08:25:47.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57940
27372024-12-21T08:25:47.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57940 req_id = 5590b52f-e8f9-4485-b85e-5e754a103c0d response_code = 200 uri = /v2p
27382024-12-21T08:25:47.403ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(11027022) }
27392024-12-21T08:25:47.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1008 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57940 req_id = 430372f7-348e-4c76-9722-bc3b44f2c259 response_code = 204 uri = /v2p
27402024-12-21T08:25:47.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33460
27412024-12-21T08:25:47.536ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5348509b-a8de-4716-9331-1517bc76b4cb, kind: Instance { id: 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11027022), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5348509b-a8de-4716-9331-1517bc76b4cb, kind: Instance { id: 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11027022), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5348509b-a8de-4716-9331-1517bc76b4cb, kind: Instance { id: 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11027022), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11027022))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5348509b-a8de-4716-9331-1517bc76b4cb, kind: Instance { id: 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11027022), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: e850e199-a9b9-47df-b530-c3562a0e31f1, slot: 0, read_only: false, vcr_json: .., name: "disk-e6733b8e874" }], boot_settings: Some(InstanceBootSettings { order: [e850e199-a9b9-47df-b530-c3562a0e31f1] }), cloud_init_bytes: Some(..) } instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa metadata = InstanceMetadata { silo_id: 657ebb02-adc9-4cbb-878a-25b2319bbb7c, project_id: 271d02da-5ab4-4b8b-997a-041783a0e713 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T08:25:47.530521310Z }
27422024-12-21T08:25:47.536ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa migration_id = None propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27432024-12-21T08:25:47.536ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa migration_id = None propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5348509b-a8de-4716-9331-1517bc76b4cb, kind: Instance { id: 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11027022), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5348509b-a8de-4716-9331-1517bc76b4cb, kind: Instance { id: 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11027022), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5348509b-a8de-4716-9331-1517bc76b4cb, kind: Instance { id: 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11027022), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11027022))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5348509b-a8de-4716-9331-1517bc76b4cb, kind: Instance { id: 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11027022), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: e850e199-a9b9-47df-b530-c3562a0e31f1, slot: 0, read_only: false, vcr_json: .., name: "disk-e6733b8e874" }], boot_settings: Some(InstanceBootSettings { order: [e850e199-a9b9-47df-b530-c3562a0e31f1] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T08:25:47.530521310Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27442024-12-21T08:25:47.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7931 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33460 req_id = ea9a324f-c6cb-4f41-b8b7-b821d27f7bff response_code = 200 uri = /vmms/21f452c6-2d91-4731-a7f0-df33d91bb339
27452024-12-21T08:25:47.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45737
27462024-12-21T08:25:47.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45737 req_id = 4e475a86-4f91-4cf9-ae47-ddb4c9dc6f14 response_code = 200 uri = /vmms/21f452c6-2d91-4731-a7f0-df33d91bb339/state
27472024-12-21T08:25:47.655ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 11027022 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27482024-12-21T08:25:47.655ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27492024-12-21T08:25:47.697ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339 file = illumos-utils/src/zone.rs:325 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27502024-12-21T08:25:47.718ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339 file = illumos-utils/src/zone.rs:363 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27512024-12-21T08:25:47.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36655
27522024-12-21T08:25:47.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36655 req_id = d203d144-515a-4bb3-aef7-0631b08c82a3 response_code = 200 uri = /vpc-routes
27532024-12-21T08:25:47.796ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {5348509b-a8de-4716-9331-1517bc76b4cb: {10.151.2.176: {a4a79614-6500-4e41-b3ad-957d531bf1b9}, 10.151.2.175: {a4a79614-6500-4e41-b3ad-957d531bf1b9}}} }
27542024-12-21T08:25:49.408ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27552024-12-21T08:25:49.408ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27562024-12-21T08:25:49.582ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 72.520295ms file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27572024-12-21T08:25:49.675ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 72.661327ms file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27582024-12-21T08:25:49.762ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 232.860974ms file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27592024-12-21T08:25:50.009ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 463.317805ms file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27602024-12-21T08:25:50.485ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 660.683491ms file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27612024-12-21T08:25:51.159ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 924.258243ms file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27622024-12-21T08:25:52.093ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 1.389721714s file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27632024-12-21T08:25:53.494ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 775.874297ms file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27642024-12-21T08:25:53.907ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61124
27652024-12-21T08:25:53.907ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61124 req_id = 164d34b3-0f70-48a6-a607-e0fc17499245 response_code = 200 uri = /baseboard
27662024-12-21T08:25:54.281ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339") failed: Property not found. retry in 895.655607ms file = illumos-utils/src/svc.rs:36 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 zone = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27672024-12-21T08:25:55.206ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339 file = sled-agent/src/instance.rs:2067 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27682024-12-21T08:25:55.216ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27692024-12-21T08:25:55.251ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27702024-12-21T08:25:55.392ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27712024-12-21T08:25:55.393ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T08:25:55.393416282Z } file = sled-agent/src/instance.rs:780 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27722024-12-21T08:25:55.393ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T08:25:55.393416282Z } propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27732024-12-21T08:25:55.393ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
27742024-12-21T08:25:55.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7597449 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36655 req_id = 29e70a2d-622e-4df4-9f8e-abdbfc1deee7 response_code = 204 uri = /eip-gateways
27752024-12-21T08:25:55.395ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T08:25:55.393416282Z }, migration_in: None, migration_out: None }
27762024-12-21T08:25:55.434ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T08:25:55.434856644Z } file = sled-agent/src/instance.rs:780 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27772024-12-21T08:25:55.434ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T08:25:55.434856644Z } propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27782024-12-21T08:25:55.434ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T08:25:55.434856644Z }, migration_in: None, migration_out: None }
27792024-12-21T08:25:55.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 603 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36655 req_id = e3d0fb9c-11b6-4350-9dc9-674dbe203971 response_code = 204 uri = /vpc-routes
27802024-12-21T08:26:05.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62854
27812024-12-21T08:26:05.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 483 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62854 req_id = bded0a82-adad-4229-ba2e-1ff3fc6b6bcc response_code = 200 uri = /vmms/21f452c6-2d91-4731-a7f0-df33d91bb339/state
27822024-12-21T08:26:05.172ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T08:26:05.172008459Z } file = sled-agent/src/instance.rs:780 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27832024-12-21T08:26:05.172ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T08:26:05.172008459Z } propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27842024-12-21T08:26:05.172ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T08:26:05.172008459Z }, migration_in: None, migration_out: None }
27852024-12-21T08:26:05.212ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T08:26:05.212204855Z } file = sled-agent/src/instance.rs:780 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27862024-12-21T08:26:05.212ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-21T08:26:05.212204855Z } propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27872024-12-21T08:26:05.212ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27882024-12-21T08:26:05.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27892024-12-21T08:26:05.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27902024-12-21T08:26:05.212ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/51857ef6-5daa-40cc-b05a-a86adda59be2/debug/bundle/zone", "/pool/int/a705724f-fca8-4ba5-9e4a-4ba744362879/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/3caa59cc-979c-4da7-a824-aa5e8414d2f9/crypt/debug", "/pool/ext/29c1565e-7974-4bcb-973b-db1b549c6ecf/crypt/debug", "/pool/ext/1f6f464f-c123-4470-96c3-74700df96380/crypt/debug", "/pool/ext/24878837-3bb1-4d27-8c56-15f8ac2e680e/crypt/debug", "/pool/ext/0e50c301-7543-4c86-ba5a-3cc2a22c5b12/crypt/debug", "/pool/ext/5c782891-c1e8-4191-bfea-a3d07d39b468/crypt/debug", "/pool/ext/26393665-bd5a-4f9d-bdcf-a6c02b4ac68a/crypt/debug", "/pool/ext/43b4495f-efdc-40ca-94f0-9afc6b7215eb/crypt/debug", "/pool/ext/7152a0da-15e8-4d64-8b5a-329e0a03fc6f/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339
27912024-12-21T08:26:05.830ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339", bundle_id: 7507c9c7-ea5e-47c1-a6e9-e429c512495b }, time_created: 2024-12-21T08:26:05.213888686Z, version: 0, cause: TerminatedInstance }
27922024-12-21T08:26:05.831ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_21f452c6-2d91-4731-a7f0-df33d91bb339 file = sled-agent/src/instance.rs:1313 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27932024-12-21T08:26:07.556ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27942024-12-21T08:26:07.573ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(11027022), kind: System }
27952024-12-21T08:26:07.573ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(11027022), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27962024-12-21T08:26:07.573ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T08:26:07.573732735Z }, migration_in: None, migration_out: None }
27972024-12-21T08:26:07.597ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T08:26:07.573732735Z }, migration_in: None, migration_out: None }
27982024-12-21T08:26:07.601ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 5cdca7c0-8c90-47df-a5dd-9e5ff6b13ffa propolis_id = 21f452c6-2d91-4731-a7f0-df33d91bb339
27992024-12-21T08:26:07.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65455
28002024-12-21T08:26:07.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65455 req_id = fc4e6e71-6b36-4042-a9d8-23e080c74090 response_code = 200 uri = /vpc-routes
28012024-12-21T08:26:08.004ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {5348509b-a8de-4716-9331-1517bc76b4cb: {10.151.2.175: {a4a79614-6500-4e41-b3ad-957d531bf1b9}, 10.151.2.176: {a4a79614-6500-4e41-b3ad-957d531bf1b9}}} }
28022024-12-21T08:26:08.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65455 req_id = 47ba61a9-5710-46e9-be7b-356abb9def9b response_code = 204 uri = /eip-gateways
28032024-12-21T08:26:08.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65455 req_id = 8ce4915c-d086-41c4-bf10-0b918db28bad response_code = 204 uri = /vpc-routes
28042024-12-21T08:26:08.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55308
28052024-12-21T08:26:08.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55308 req_id = 54d590af-533f-4b60-8b72-8f8ccb9795b3 response_code = 200 uri = /v2p
28062024-12-21T08:26:08.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36548
28072024-12-21T08:26:08.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36548 req_id = 92a0f25c-7025-4818-9b5a-98dfdfd69362 response_code = 200 uri = /vpc-routes
28082024-12-21T08:26:08.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41513
28092024-12-21T08:26:08.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41513 req_id = 1f0df543-8fd0-4529-86a7-206d40ce522c response_code = 200 uri = /v2p
28102024-12-21T08:26:08.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62741
28112024-12-21T08:26:08.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62741 req_id = 40c29f8f-f705-49ef-afa9-0b0831625502 response_code = 200 uri = /vpc-routes
28122024-12-21T08:26:08.496ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
28132024-12-21T08:26:08.496ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48
28142024-12-21T08:26:08.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36548 req_id = dfdc2429-5eb0-49d8-ba19-793aaf3837e2 response_code = 204 uri = /eip-gateways
28152024-12-21T08:26:08.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
28162024-12-21T08:26:08.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62741 req_id = 9a0376f3-84ea-4bbd-8a63-04b4a2dd2e92 response_code = 204 uri = /eip-gateways
28172024-12-21T08:26:08.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36548 req_id = 90ce427b-c5f1-4160-9fdb-8c3ff15abac3 response_code = 204 uri = /vpc-routes
28182024-12-21T08:26:08.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62741 req_id = 92a29770-959d-46a0-9b6f-b08335567d3d response_code = 204 uri = /vpc-routes
28192024-12-21T08:26:08.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34562
28202024-12-21T08:26:08.532ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28212024-12-21T08:26:08.573ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28222024-12-21T08:26:08.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102624 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34562 req_id = dc5b4e2b-ec74-41be-86f3-ba8817f5035e response_code = 204 uri = /switch-ports
28232024-12-21T08:26:08.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61861
28242024-12-21T08:26:08.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61746
28252024-12-21T08:26:08.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53539
28262024-12-21T08:26:08.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34562 req_id = 1452df02-9499-46f4-a416-a12a77db41fe response_code = 200 uri = /network-bootstore-config
28272024-12-21T08:26:08.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53539 req_id = 5488e774-5b27-43d6-8e25-e1a566a43ca3 response_code = 200 uri = /v2p
28282024-12-21T08:26:08.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61861 req_id = 2002cb57-3456-48fe-ae7a-8f467072448e response_code = 200 uri = /v2p
28292024-12-21T08:26:08.636ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28302024-12-21T08:26:08.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53828
28312024-12-21T08:26:08.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53828 req_id = 35f95a3b-a074-4a5d-9af3-8694e2f4eaf3 response_code = 200 uri = /vpc-routes
28322024-12-21T08:26:08.674ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28332024-12-21T08:26:08.749ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
28342024-12-21T08:26:08.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53828 req_id = cc3b6d6e-2e08-475e-bd78-de011b78c0e6 response_code = 204 uri = /eip-gateways
28352024-12-21T08:26:08.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114587 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61746 req_id = f4414f5c-8bcb-462f-81f0-1c0ae7c16be7 response_code = 204 uri = /switch-ports
28362024-12-21T08:26:08.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61746 req_id = 8e250583-2702-4f0c-a56d-d10bf4c8ee19 response_code = 200 uri = /network-bootstore-config
28372024-12-21T08:26:08.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53828 req_id = 595564c0-911d-46f2-813f-258cb4cd7cd7 response_code = 204 uri = /vpc-routes
28382024-12-21T08:26:08.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53461
28392024-12-21T08:26:08.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53461 req_id = c04cabd5-bb69-4275-ac88-0e43314e5f64 response_code = 200 uri = /v2p
28402024-12-21T08:26:08.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35365
28412024-12-21T08:26:08.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35365 req_id = 0e1638d6-c6e2-49f2-befe-be2ebac915f4 response_code = 200 uri = /vpc-routes
28422024-12-21T08:26:08.959ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
28432024-12-21T08:26:08.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35365 req_id = f511994c-d129-45c2-8424-cde086326b53 response_code = 204 uri = /eip-gateways
28442024-12-21T08:26:08.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62218
28452024-12-21T08:26:08.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28462024-12-21T08:26:09.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28472024-12-21T08:26:09.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62218 req_id = f473be99-06a3-483c-8059-5030f663e7c4 response_code = 204 uri = /switch-ports
28482024-12-21T08:26:09.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35365 req_id = 3514a16d-d93e-47af-bfc9-3349b35e3e0c response_code = 204 uri = /vpc-routes
28492024-12-21T08:26:09.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62218 req_id = ba29197b-f16d-4195-8570-c693fd9eafb2 response_code = 200 uri = /network-bootstore-config
28502024-12-21T08:26:09.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58839
28512024-12-21T08:26:09.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58839 req_id = d04ad175-8ed8-4966-884b-cfee18df0899 response_code = 200 uri = /vpc-routes
28522024-12-21T08:26:09.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 118e564e-0bce-46c7-b69d-5b3dee81ed48 values = ExternalIpGatewayMap { mappings: {} }
28532024-12-21T08:26:09.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58839 req_id = 3e6ad392-5040-4b05-bdc5-529fb11c4ce3 response_code = 204 uri = /eip-gateways
28542024-12-21T08:26:09.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58839 req_id = f1c374cb-fcf3-45e8-a9c8-0ab2a8adb074 response_code = 204 uri = /vpc-routes