Max level shown:
1 [ Dec 13 22:58:04 Enabled. ]
2 [ Dec 13 22:58:04 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 13 22:58:04 Method "start" exited with status 0. ]
4 [ Dec 13 22:58:04 Rereading configuration. ]
5 [ Dec 13 22:58:04 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-13T22:58:04.626ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-13T22:58:04.627ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-13T22:58:04.679ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-13T22:58:04.679ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-13T22:58:04.796ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-13T22:58:04.805ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-13T22:58:04.813ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-13T22:58:05.414ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-13T22:58:05.558ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-13T22:58:05.558ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-13T22:58:05.558ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-13T22:58:05.558ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-13T22:58:05.558ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-12-13T22:58:05.558ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-12-13T22:58:05.561ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-13T22:58:05.561ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-13T22:58:05.561ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-13T22:58:05.561ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-13T22:58:05.561ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-13T22:58:05.561ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-13T22:58:05.561ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
282024-12-13T22:58:05.561ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-13T22:58:05.561ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-13T22:58:05.573ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-13T22:58:05.573ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool)
322024-12-13T22:58:05.670ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal }
332024-12-13T22:58:06.026ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:606
342024-12-13T22:58:06.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-13T22:58:06.027ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-13T22:58:06.027ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-13T22:58:06.027ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
382024-12-13T22:58:06.027ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-13T22:58:06.027ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-13T22:58:06.035ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-13T22:58:06.035ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 12195489-dcbe-4d54-a310-73dc60950fee (zpool)
422024-12-13T22:58:06.125ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal }
432024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
482024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
542024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
572024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
632024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
722024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
782024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
812024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
872024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-13T22:58:06.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:606
932024-12-13T22:58:06.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-13T22:58:06.483ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-13T22:58:06.483ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-13T22:58:06.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
1002024-12-13T22:58:06.483ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-12-13T22:58:06.483ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-12-13T22:58:06.483ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-13T22:58:06.483ZINFOSledAgent (bootstore): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-13T22:58:06.483ZINFOSledAgent (bootstore): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-13T22:58:06.483ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-13T22:58:06.483ZINFOSledAgent (bootstore): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-13T22:58:06.483ZINFOSledAgent (bootstore): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-13T22:58:06.483ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-13T22:58:06.483ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-13T22:58:06.483ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-13T22:58:06.494ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-13T22:58:06.494ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1332, tv_nsec: 393623107 } time_to_next_cleanup = 599.999927889s
1142024-12-13T22:58:06.494ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
1152024-12-13T22:58:06.494ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1162024-12-13T22:58:06.494ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-13T22:58:06.497ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-13T22:58:06.497ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-13T22:58:06.499ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-13T22:58:06.500ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-13T22:58:06.500ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-13T22:58:06.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
1232024-12-13T22:58:06.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
1242024-12-13T22:58:06.500ZINFOSledAgent (RSS): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-13T22:58:06.500ZINFOSledAgent (RSS): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-13T22:58:06.500ZINFOSledAgent (RSS): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-13T22:58:06.500ZINFOSledAgent (RSS): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-13T22:58:06.500ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-13T22:58:06.500ZINFOSledAgent (RSS): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-13T22:58:06.500ZINFOSledAgent (RSS): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-13T22:58:06.500ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-13T22:58:06.500ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-13T22:58:06.500ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-13T22:58:06.500ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-13T22:58:06.500ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-13T22:58:06.500ZINFOSledAgent (bootstore): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-13T22:58:06.501ZINFOSledAgent (bootstore): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-13T22:58:06.501ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-13T22:58:06.501ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c991c27b-85ad-498c-8a93-464bd3ce406f (sled), rack_id: ab5f3f90-9631-40a3-aa5d-74a5ed48ca25, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-13T22:58:06.501ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-13T22:58:06.501ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-13T22:58:06.506ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-13T22:58:06.512ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-13T22:58:06.512ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-13T22:58:06.516ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-13T22:58:06.516ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-13T22:58:06.516ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:39627
1482024-12-13T22:58:06.517ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c991c27b-85ad-498c-8a93-464bd3ce406f (sled), rack_id: ab5f3f90-9631-40a3-aa5d-74a5ed48ca25, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-13T22:58:06.517ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-13T22:58:06.517ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-13T22:58:06.517ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-13T22:58:06.517ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:606
1532024-12-13T22:58:06.517ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:812
1542024-12-13T22:58:06.517ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-13T22:58:06.517ZINFOSledAgent (StorageManager): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-13T22:58:06.517ZINFOSledAgent (StorageManager): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-13T22:58:06.517ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:801
1582024-12-13T22:58:06.517ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:829
1592024-12-13T22:58:06.517ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:595
1602024-12-13T22:58:06.517ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-13T22:58:06.517ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:700 result = DisksManagementResult { status: [] }
1622024-12-13T22:58:06.533ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
1632024-12-13T22:58:06.554ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-13T22:58:06.572ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-13T22:58:06.579ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1662024-12-13T22:58:06.579ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
1672024-12-13T22:58:06.579ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1682024-12-13T22:58:06.579ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-13T22:58:06.582ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 127.044166ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2545d36b-9f75-4705-a9be-ff1282226957", "content-length": "124", "date": "Fri, 13 Dec 2024 22:58:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2545d36b-9f75-4705-a9be-ff1282226957" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-13T22:58:06.592ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_04278734-afb9-43d6-af45-7faeeb868ab0/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-13T22:58:06.615ZINFOSledAgent: successfully created encrypted zvol: name="oxi_04278734-afb9-43d6-af45-7faeeb868ab0/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-13T22:58:06.615ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_04278734-afb9-43d6-af45-7faeeb868ab0/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-13T22:58:06.620ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1742024-12-13T22:58:06.620ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752024-12-13T22:58:06.620ZINFOSledAgent (BackingFs): Ensuring dataset oxi_04278734-afb9-43d6-af45-7faeeb868ab0/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762024-12-13T22:58:06.687ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772024-12-13T22:58:06.709ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-13T22:58:06.710ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 152.63774ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cba819a1-636d-4ed2-be17-abc82f12feba", "content-length": "124", "date": "Fri, 13 Dec 2024 22:58:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cba819a1-636d-4ed2-be17-abc82f12feba" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-13T22:58:06.863ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-13T22:58:06.864ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 128.777771ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ca44aca8-5904-47e9-b061-a26144cc30f0", "content-length": "124", "date": "Fri, 13 Dec 2024 22:58:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ca44aca8-5904-47e9-b061-a26144cc30f0" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-13T22:58:06.906ZINFOSledAgent (BackingFs): Mounting oxi_04278734-afb9-43d6-af45-7faeeb868ab0/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822024-12-13T22:58:06.919ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832024-12-13T22:58:06.919ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842024-12-13T22:58:06.919ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852024-12-13T22:58:06.919ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862024-12-13T22:58:06.993ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-13T22:58:06.994ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 128.150456ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1cca4d38-1e5e-4fbe-b116-bae0e0aa44ff", "content-length": "124", "date": "Fri, 13 Dec 2024 22:58:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1cca4d38-1e5e-4fbe-b116-bae0e0aa44ff" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-13T22:58:07.123ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-13T22:58:07.124ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 309.234017ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "88f81c5e-65eb-45ea-944a-5c6702a06d30", "content-length": "124", "date": "Fri, 13 Dec 2024 22:58:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "88f81c5e-65eb-45ea-944a-5c6702a06d30" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-13T22:58:07.435ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-13T22:58:07.436ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 359.10114ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fda58823-2134-428b-a903-b24084cef89a", "content-length": "124", "date": "Fri, 13 Dec 2024 22:58:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fda58823-2134-428b-a903-b24084cef89a" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-13T22:58:07.648ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1932024-12-13T22:58:07.654ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:46200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1942024-12-13T22:58:07.654ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1952024-12-13T22:58:07.654ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:46200 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = c991c27b-85ad-498c-8a93-464bd3ce406f sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1962024-12-13T22:58:07.655ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 339.800453ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1972024-12-13T22:58:07.656ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1982024-12-13T22:58:07.656ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
1992024-12-13T22:58:07.656ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2002024-12-13T22:58:07.656ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012024-12-13T22:58:07.795ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022024-12-13T22:58:07.997ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 368.052546ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2032024-12-13T22:58:08.367ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 745.719908ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2042024-12-13T22:58:09.116ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.403825629s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2052024-12-13T22:58:10.200ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2062024-12-13T22:58:10.200ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2072024-12-13T22:58:10.200ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2082024-12-13T22:58:10.200ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2092024-12-13T22:58:10.200ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2102024-12-13T22:58:10.200ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2112024-12-13T22:58:10.202ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2122024-12-13T22:58:10.203ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2132024-12-13T22:58:10.203ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='52ed4c83-3953-469c-8c7d-f6af8a2e9353'/> <propval type="astring" name="rack_id" value='ab5f3f90-9631-40a3-aa5d-74a5ed48ca25'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fec3:2bb3'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='ab5f3f90-9631-40a3-aa5d-74a5ed48ca25'/> <propval type="astring" name="sled_id" value='c991c27b-85ad-498c-8a93-464bd3ce406f'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='c991c27b-85ad-498c-8a93-464bd3ce406f'/> <propval type="astring" name="rack_uuid" value='ab5f3f90-9631-40a3-aa5d-74a5ed48ca25'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='c991c27b-85ad-498c-8a93-464bd3ce406f'/> <propval type="astring" name="rack_uuid" value='ab5f3f90-9631-40a3-aa5d-74a5ed48ca25'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-13T22:58:10.203ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-13T22:58:10.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 65.053294ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-13T22:58:10.568ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.105372493s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2172024-12-13T22:58:10.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 72.662056ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-13T22:58:10.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 259.512573ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-13T22:58:11.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 575.965521ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-13T22:58:11.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.125718978s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-13T22:58:13.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.360873489s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-13T22:58:14.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.384187541s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-13T22:58:14.810ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.979401242s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2242024-12-13T22:58:16.563ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/nexus.rs:527 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2252024-12-13T22:58:16.594ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
2262024-12-13T22:58:16.595ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2272024-12-13T22:58:16.596ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2282024-12-13T22:58:16.596ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2292024-12-13T22:58:16.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
2302024-12-13T22:58:16.596ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312024-12-13T22:58:16.596ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-12-13T22:58:16.596ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2332024-12-13T22:58:16.596ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2342024-12-13T22:58:16.596ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2352024-12-13T22:58:16.596ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:39627
2362024-12-13T22:58:16.802ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2372024-12-13T22:58:16.802ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2382024-12-13T22:58:16.807ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2392024-12-13T22:58:16.807ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2402024-12-13T22:58:16.807ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2412024-12-13T22:58:17.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52812
2422024-12-13T22:58:17.063ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
2432024-12-13T22:58:17.063ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
2442024-12-13T22:58:17.063ZINFOSledAgent (ServiceManager): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:188
2452024-12-13T22:58:17.063ZINFOSledAgent (ServiceManager): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:188
2462024-12-13T22:58:17.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 502 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52812 req_id = 0cdc200f-e0a1-4c8a-9b9c-a6c597c55475 response_code = 200 uri = /inventory
2472024-12-13T22:58:17.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40500
2482024-12-13T22:58:17.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40500 req_id = ce0e6a2b-2d45-4948-a8e0-06a3db1bcd69 response_code = 200 uri = /sled-role
2492024-12-13T22:58:17.125ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c54d3df1-092e-4229-8d36-42e8790c6614 (physical_disk), pool_id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 151e5863-0716-4813-b639-6a307a4e05bf (physical_disk), pool_id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 44a6cb74-9b55-41c4-a35e-48644fda8be8 (physical_disk), pool_id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 314d8cca-506d-4643-bc31-1c51eff68e48 (physical_disk), pool_id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: d751f288-6038-4fe0-a5fc-5d6522428eec (physical_disk), pool_id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ee69b4e2-7cf6-463e-9ee4-e62f60826d51 (physical_disk), pool_id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 451fd11f-006f-4fa2-aba6-ddf2a6e38571 (physical_disk), pool_id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: a953322a-2685-48e2-a466-a21add6f0344 (physical_disk), pool_id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 7b60918c-27f2-4d12-a404-f7b71ee9bbe9 (physical_disk), pool_id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2502024-12-13T22:58:17.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40088
2512024-12-13T22:58:17.126ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2522024-12-13T22:58:17.126ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c54d3df1-092e-4229-8d36-42e8790c6614 (physical_disk), pool_id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 151e5863-0716-4813-b639-6a307a4e05bf (physical_disk), pool_id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 44a6cb74-9b55-41c4-a35e-48644fda8be8 (physical_disk), pool_id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 314d8cca-506d-4643-bc31-1c51eff68e48 (physical_disk), pool_id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: d751f288-6038-4fe0-a5fc-5d6522428eec (physical_disk), pool_id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ee69b4e2-7cf6-463e-9ee4-e62f60826d51 (physical_disk), pool_id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 451fd11f-006f-4fa2-aba6-ddf2a6e38571 (physical_disk), pool_id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: a953322a-2685-48e2-a466-a21add6f0344 (physical_disk), pool_id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 7b60918c-27f2-4d12-a404-f7b71ee9bbe9 (physical_disk), pool_id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:606
2532024-12-13T22:58:17.126ZINFOSledAgent (StorageManager): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2542024-12-13T22:58:17.126ZINFOSledAgent (StorageManager): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552024-12-13T22:58:17.126ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1297 request = omicron_physical_disks_ensure
2562024-12-13T22:58:17.126ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2572024-12-13T22:58:17.126ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2582024-12-13T22:58:17.126ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2592024-12-13T22:58:17.126ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2602024-12-13T22:58:17.263ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2612024-12-13T22:58:17.263ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f7cfdce7-5264-4421-96d5-85418ddb748d (zpool)
2622024-12-13T22:58:17.723ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2632024-12-13T22:58:17.725ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 995157440737059926 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2642024-12-13T22:58:17.725ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/probe_manager.rs:231 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2652024-12-13T22:58:17.725ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4994363618683968739 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
2662024-12-13T22:58:17.784ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }
2672024-12-13T22:58:17.793ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2682024-12-13T22:58:17.793ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2692024-12-13T22:58:17.793ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2702024-12-13T22:58:17.793ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2712024-12-13T22:58:17.793ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722024-12-13T22:58:17.793ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-13T22:58:17.793ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2742024-12-13T22:58:17.830ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752024-12-13T22:58:17.838ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone file = sled-storage/src/dataset.rs:304
2762024-12-13T22:58:17.979ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f7cfdce7-5264-4421-96d5-85418ddb748d file = sled-storage/src/dataset.rs:391
2772024-12-13T22:58:17.987ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2782024-12-13T22:58:17.987ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2792024-12-13T22:58:17.987ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2802024-12-13T22:58:17.987ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812024-12-13T22:58:17.987ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2822024-12-13T22:58:17.997ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2832024-12-13T22:58:17.997ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cb54037f-125a-4af3-8595-b53b9b45d26a (zpool)
2842024-12-13T22:58:18.090ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }
2852024-12-13T22:58:18.097ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2862024-12-13T22:58:18.097ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2872024-12-13T22:58:18.097ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2882024-12-13T22:58:18.097ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2892024-12-13T22:58:18.097ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902024-12-13T22:58:18.098ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912024-12-13T22:58:18.098ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2922024-12-13T22:58:18.131ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932024-12-13T22:58:18.141ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone file = sled-storage/src/dataset.rs:304
2942024-12-13T22:58:18.279ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cb54037f-125a-4af3-8595-b53b9b45d26a file = sled-storage/src/dataset.rs:391
2952024-12-13T22:58:18.287ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2962024-12-13T22:58:18.287ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2972024-12-13T22:58:18.287ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2982024-12-13T22:58:18.287ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2992024-12-13T22:58:18.287ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3002024-12-13T22:58:18.296ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3012024-12-13T22:58:18.296ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7ecf842b-e498-4351-b151-8dff95453908 (zpool)
3022024-12-13T22:58:18.387ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }
3032024-12-13T22:58:18.394ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3042024-12-13T22:58:18.394ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3052024-12-13T22:58:18.394ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3062024-12-13T22:58:18.394ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3072024-12-13T22:58:18.394ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-12-13T22:58:18.394ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092024-12-13T22:58:18.394ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3102024-12-13T22:58:18.429ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3112024-12-13T22:58:18.437ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7ecf842b-e498-4351-b151-8dff95453908/crypt/zone file = sled-storage/src/dataset.rs:304
3122024-12-13T22:58:18.577ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7ecf842b-e498-4351-b151-8dff95453908 file = sled-storage/src/dataset.rs:391
3132024-12-13T22:58:18.586ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3142024-12-13T22:58:18.586ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3152024-12-13T22:58:18.586ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3162024-12-13T22:58:18.586ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3172024-12-13T22:58:18.586ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3182024-12-13T22:58:18.596ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3192024-12-13T22:58:18.596ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 27177673-3a08-4285-914d-2d0755afcc21 (zpool)
3202024-12-13T22:58:18.690ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }
3212024-12-13T22:58:18.699ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3222024-12-13T22:58:18.699ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3232024-12-13T22:58:18.699ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3242024-12-13T22:58:18.699ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3252024-12-13T22:58:18.699ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-12-13T22:58:18.699ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272024-12-13T22:58:18.699ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3282024-12-13T22:58:18.726ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/probe_manager.rs:231 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
3292024-12-13T22:58:18.734ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302024-12-13T22:58:18.742ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_27177673-3a08-4285-914d-2d0755afcc21/crypt/zone file = sled-storage/src/dataset.rs:304
3312024-12-13T22:58:18.879ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_27177673-3a08-4285-914d-2d0755afcc21 file = sled-storage/src/dataset.rs:391
3322024-12-13T22:58:18.887ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3332024-12-13T22:58:18.887ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3342024-12-13T22:58:18.887ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3352024-12-13T22:58:18.887ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3362024-12-13T22:58:18.887ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3372024-12-13T22:58:18.897ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3382024-12-13T22:58:18.897ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool)
3392024-12-13T22:58:18.989ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }
3402024-12-13T22:58:18.997ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3412024-12-13T22:58:18.997ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3422024-12-13T22:58:18.997ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3432024-12-13T22:58:18.997ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3442024-12-13T22:58:18.997ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452024-12-13T22:58:18.997ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-12-13T22:58:18.997ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3472024-12-13T22:58:19.032ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3482024-12-13T22:58:19.041ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone file = sled-storage/src/dataset.rs:304
3492024-12-13T22:58:19.181ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b file = sled-storage/src/dataset.rs:391
3502024-12-13T22:58:19.190ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3512024-12-13T22:58:19.190ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3522024-12-13T22:58:19.190ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3532024-12-13T22:58:19.190ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3542024-12-13T22:58:19.190ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3552024-12-13T22:58:19.200ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3562024-12-13T22:58:19.200ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool)
3572024-12-13T22:58:19.294ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }
3582024-12-13T22:58:19.302ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3592024-12-13T22:58:19.302ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3602024-12-13T22:58:19.302ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3612024-12-13T22:58:19.302ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3622024-12-13T22:58:19.302ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-12-13T22:58:19.303ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642024-12-13T22:58:19.303ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3652024-12-13T22:58:19.338ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3662024-12-13T22:58:19.346ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/zone file = sled-storage/src/dataset.rs:304
3672024-12-13T22:58:19.483ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_46df782d-5e10-4410-8b6c-9b413351c0ef file = sled-storage/src/dataset.rs:391
3682024-12-13T22:58:19.490ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3692024-12-13T22:58:19.491ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3702024-12-13T22:58:19.491ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3712024-12-13T22:58:19.491ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3722024-12-13T22:58:19.491ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3732024-12-13T22:58:19.500ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3742024-12-13T22:58:19.500ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool)
3752024-12-13T22:58:19.592ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }
3762024-12-13T22:58:19.600ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3772024-12-13T22:58:19.600ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3782024-12-13T22:58:19.600ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3792024-12-13T22:58:19.600ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3802024-12-13T22:58:19.600ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-12-13T22:58:19.600ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822024-12-13T22:58:19.600ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3832024-12-13T22:58:19.636ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3842024-12-13T22:58:19.644ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crypt/zone file = sled-storage/src/dataset.rs:304
3852024-12-13T22:58:19.728ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/probe_manager.rs:231 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
3862024-12-13T22:58:19.779ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c file = sled-storage/src/dataset.rs:391
3872024-12-13T22:58:19.787ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3882024-12-13T22:58:19.787ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3892024-12-13T22:58:19.787ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3902024-12-13T22:58:19.787ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3912024-12-13T22:58:19.787ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3922024-12-13T22:58:19.796ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3932024-12-13T22:58:19.796ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 66612a50-feea-47ce-a70f-e7d816b9348f (zpool)
3942024-12-13T22:58:19.889ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }
3952024-12-13T22:58:19.896ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
3962024-12-13T22:58:19.896ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
3972024-12-13T22:58:19.896ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
3982024-12-13T22:58:19.896ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
3992024-12-13T22:58:19.896ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002024-12-13T22:58:19.896ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012024-12-13T22:58:19.896ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4022024-12-13T22:58:19.929ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4032024-12-13T22:58:19.936ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone file = sled-storage/src/dataset.rs:304
4042024-12-13T22:58:20.077ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_66612a50-feea-47ce-a70f-e7d816b9348f file = sled-storage/src/dataset.rs:391
4052024-12-13T22:58:20.085ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4062024-12-13T22:58:20.085ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4072024-12-13T22:58:20.085ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4082024-12-13T22:58:20.085ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4092024-12-13T22:58:20.085ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4102024-12-13T22:58:20.095ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4112024-12-13T22:58:20.095ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool)
4122024-12-13T22:58:20.190ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }
4132024-12-13T22:58:20.198ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4142024-12-13T22:58:20.198ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4152024-12-13T22:58:20.198ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4162024-12-13T22:58:20.198ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4172024-12-13T22:58:20.198ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-12-13T22:58:20.198ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192024-12-13T22:58:20.198ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4202024-12-13T22:58:20.234ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4212024-12-13T22:58:20.242ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785/crypt/zone file = sled-storage/src/dataset.rs:304
4222024-12-13T22:58:20.374ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785 file = sled-storage/src/dataset.rs:391
4232024-12-13T22:58:20.382ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4242024-12-13T22:58:20.382ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4252024-12-13T22:58:20.382ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4262024-12-13T22:58:20.382ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04278734-afb9-43d6-af45-7faeeb868ab0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 12195489-dcbe-4d54-a310-73dc60950fee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4272024-12-13T22:58:20.382ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4282024-12-13T22:58:20.382ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4292024-12-13T22:58:20.382ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302024-12-13T22:58:20.383ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4312024-12-13T22:58:20.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
4322024-12-13T22:58:20.383ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4332024-12-13T22:58:20.383ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4342024-12-13T22:58:20.383ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4352024-12-13T22:58:20.383ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4362024-12-13T22:58:20.383ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4372024-12-13T22:58:20.383ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4382024-12-13T22:58:20.383ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4392024-12-13T22:58:20.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3257372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40088 req_id = 8ceac5d0-10b9-49dc-819e-f5b2a07dd0bc response_code = 200 uri = /omicron-physical-disks
4402024-12-13T22:58:20.415ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {001fb0cd-bf54-4a29-ac44-00a316906a7a (dataset): DatasetConfig { id: 001fb0cd-bf54-4a29-ac44-00a316906a7a (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0512ec25-1dc1-4214-8edb-69e12bfad278 (dataset): DatasetConfig { id: 0512ec25-1dc1-4214-8edb-69e12bfad278 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08191ec0-f266-440f-bdb2-a3fb298dd626 (dataset): DatasetConfig { id: 08191ec0-f266-440f-bdb2-a3fb298dd626 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 10f3f2c2-e0c9-4c85-b609-d182ff3ddbdd (dataset): DatasetConfig { id: 10f3f2c2-e0c9-4c85-b609-d182ff3ddbdd (dataset), name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d836bd6-9bf2-483f-9ea1-b6820ff78ae4 (dataset): DatasetConfig { id: 1d836bd6-9bf2-483f-9ea1-b6820ff78ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 226b91b7-5dca-47b0-aa32-eedf06a5be32 (dataset): DatasetConfig { id: 226b91b7-5dca-47b0-aa32-eedf06a5be32 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27325b98-a923-4e85-a5cd-6f2ec271d209 (dataset): DatasetConfig { id: 27325b98-a923-4e85-a5cd-6f2ec271d209 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 294c1c38-a666-4094-98f9-40a27eaba4bb (dataset): DatasetConfig { id: 294c1c38-a666-4094-98f9-40a27eaba4bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29e41d3c-f2a4-403f-9dc1-12c267b402a8 (dataset): DatasetConfig { id: 29e41d3c-f2a4-403f-9dc1-12c267b402a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bd7e4c7-109a-4882-b1e1-bba983d2be15 (dataset): DatasetConfig { id: 2bd7e4c7-109a-4882-b1e1-bba983d2be15 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3547374a-938a-4510-b911-42a1566a263d (dataset): DatasetConfig { id: 3547374a-938a-4510-b911-42a1566a263d (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36ec72d3-ed7e-4da2-b0b6-0fb09752b316 (dataset): DatasetConfig { id: 36ec72d3-ed7e-4da2-b0b6-0fb09752b316 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a16b178-a276-49b2-8f65-52041a99bd8b (dataset): DatasetConfig { id: 3a16b178-a276-49b2-8f65-52041a99bd8b (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45111151-a90c-47be-8d40-205102c291d6 (dataset): DatasetConfig { id: 45111151-a90c-47be-8d40-205102c291d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45a86cc3-eef3-4499-900c-2df3d0593102 (dataset): DatasetConfig { id: 45a86cc3-eef3-4499-900c-2df3d0593102 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46448dad-7b6b-4afc-b479-d5d58f48464a (dataset): DatasetConfig { id: 46448dad-7b6b-4afc-b479-d5d58f48464a (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af2c683-1f09-4191-ba49-062e3eeb2836 (dataset): DatasetConfig { id: 4af2c683-1f09-4191-ba49-062e3eeb2836 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bee4697-4fd5-4a0a-a883-cdb37feae8d9 (dataset): DatasetConfig { id: 4bee4697-4fd5-4a0a-a883-cdb37feae8d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 509d770d-1da9-4253-84ca-baec93796415 (dataset): DatasetConfig { id: 509d770d-1da9-4253-84ca-baec93796415 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 543b5d1a-9957-4a1b-910c-1229d762a4e9 (dataset): DatasetConfig { id: 543b5d1a-9957-4a1b-910c-1229d762a4e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 568b92d6-59b3-420d-9c09-eee94fc56b47 (dataset): DatasetConfig { id: 568b92d6-59b3-420d-9c09-eee94fc56b47 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5fd80428-6850-4fdc-a8c1-b87c14f49dc5 (dataset): DatasetConfig { id: 5fd80428-6850-4fdc-a8c1-b87c14f49dc5 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 67fd861c-b52f-428e-b4f8-114ea68398e1 (dataset): DatasetConfig { id: 67fd861c-b52f-428e-b4f8-114ea68398e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 685885df-4f93-4e64-baf3-7e4fa6ef80b4 (dataset): DatasetConfig { id: 685885df-4f93-4e64-baf3-7e4fa6ef80b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ca23842-9e96-4193-ae25-c3f4d5f4e83a (dataset): DatasetConfig { id: 6ca23842-9e96-4193-ae25-c3f4d5f4e83a (dataset), name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7a516fa2-b580-4af6-a2b7-7d0b4ee77cba (dataset): DatasetConfig { id: 7a516fa2-b580-4af6-a2b7-7d0b4ee77cba (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7af4eca6-1056-4ea7-9e81-f3011113fa31 (dataset): DatasetConfig { id: 7af4eca6-1056-4ea7-9e81-f3011113fa31 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b2282c8-13fc-40c9-9bba-d894cab8aa86 (dataset): DatasetConfig { id: 7b2282c8-13fc-40c9-9bba-d894cab8aa86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82a247e0-5282-4fd9-aea7-1ed9d853028d (dataset): DatasetConfig { id: 82a247e0-5282-4fd9-aea7-1ed9d853028d (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 863c1163-c297-42db-a409-54145be09c58 (dataset): DatasetConfig { id: 863c1163-c297-42db-a409-54145be09c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86463141-e819-4b9d-a9ea-79e4a8290016 (dataset): DatasetConfig { id: 86463141-e819-4b9d-a9ea-79e4a8290016 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ea24e43-3f3a-4fc3-b8ca-0151a9a27f25 (dataset): DatasetConfig { id: 8ea24e43-3f3a-4fc3-b8ca-0151a9a27f25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9443ef3d-af15-4078-ab19-d3dd9cfbd551 (dataset): DatasetConfig { id: 9443ef3d-af15-4078-ab19-d3dd9cfbd551 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aaffb4ac-1975-48c1-bdea-2a9cf031a9de (dataset): DatasetConfig { id: aaffb4ac-1975-48c1-bdea-2a9cf031a9de (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab458b5a-263c-4c1d-a733-f146fca9b35d (dataset): DatasetConfig { id: ab458b5a-263c-4c1d-a733-f146fca9b35d (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b054e974-f734-44f4-8a5d-cfbab2c9d672 (dataset): DatasetConfig { id: b054e974-f734-44f4-8a5d-cfbab2c9d672 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6be62d5-249d-487c-b314-89c452bc1e37 (dataset): DatasetConfig { id: b6be62d5-249d-487c-b314-89c452bc1e37 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6fd3eaf-3b95-48b3-89a7-568aaaf30d34 (dataset): DatasetConfig { id: b6fd3eaf-3b95-48b3-89a7-568aaaf30d34 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bdd79a30-f41b-4378-be9f-dd2a1449a54c (dataset): DatasetConfig { id: bdd79a30-f41b-4378-be9f-dd2a1449a54c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf8f206f-2c62-4cf4-895b-0a3a91d80679 (dataset): DatasetConfig { id: bf8f206f-2c62-4cf4-895b-0a3a91d80679 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c36a6eea-31d4-444d-bcc9-a5b093a55d49 (dataset): DatasetConfig { id: c36a6eea-31d4-444d-bcc9-a5b093a55d49 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3b765d1-c0e3-47ec-bf2e-1c2c6b8d2a61 (dataset): DatasetConfig { id: c3b765d1-c0e3-47ec-bf2e-1c2c6b8d2a61 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c6be42b8-8ec2-4899-bbf9-d90ffd4b7d32 (dataset): DatasetConfig { id: c6be42b8-8ec2-4899-bbf9-d90ffd4b7d32 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c87d5976-44f1-45ca-a948-c0622d92a9c0 (dataset): DatasetConfig { id: c87d5976-44f1-45ca-a948-c0622d92a9c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c99908d4-7455-48c1-8daa-b6b08c808d83 (dataset): DatasetConfig { id: c99908d4-7455-48c1-8daa-b6b08c808d83 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce15b21d-4516-475a-b2eb-24ba587e1cca (dataset): DatasetConfig { id: ce15b21d-4516-475a-b2eb-24ba587e1cca (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d161b427-4c82-4661-b190-65cbf0f8e218 (dataset): DatasetConfig { id: d161b427-4c82-4661-b190-65cbf0f8e218 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1f323fe-10e0-433f-b523-89c35b719705 (dataset): DatasetConfig { id: d1f323fe-10e0-433f-b523-89c35b719705 (dataset), name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2a05747-11c1-49c7-991e-0fadbcd64fdb (dataset): DatasetConfig { id: d2a05747-11c1-49c7-991e-0fadbcd64fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3824f3c-1648-4733-b48f-871d10a82808 (dataset): DatasetConfig { id: d3824f3c-1648-4733-b48f-871d10a82808 (dataset), name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d657bc0a-c3af-4e17-aea2-38083c17faf7 (dataset): DatasetConfig { id: d657bc0a-c3af-4e17-aea2-38083c17faf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfc38796-8acd-4e4d-a954-aae83f963220 (dataset): DatasetConfig { id: dfc38796-8acd-4e4d-a954-aae83f963220 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0659a3a-7b4a-41de-915f-e74c4a7a154c (dataset): DatasetConfig { id: e0659a3a-7b4a-41de-915f-e74c4a7a154c (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e908ec56-4c89-4c16-841b-17ac55923c20 (dataset): DatasetConfig { id: e908ec56-4c89-4c16-841b-17ac55923c20 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea138aa6-57a3-49d2-bcf7-5f2793859a53 (dataset): DatasetConfig { id: ea138aa6-57a3-49d2-bcf7-5f2793859a53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea7c5907-d4ef-4702-b650-9eba7a6c4137 (dataset): DatasetConfig { id: ea7c5907-d4ef-4702-b650-9eba7a6c4137 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebd403d4-4ec5-4670-8e3b-0c01bb1aaeaf (dataset): DatasetConfig { id: ebd403d4-4ec5-4670-8e3b-0c01bb1aaeaf (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed300e5f-6334-4e62-a96c-3977e5894952 (dataset): DatasetConfig { id: ed300e5f-6334-4e62-a96c-3977e5894952 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee6f255e-a6e9-40d9-98d9-47a8ad6c27a7 (dataset): DatasetConfig { id: ee6f255e-a6e9-40d9-98d9-47a8ad6c27a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1509088-053c-4e9d-9899-1f2fa35f80ab (dataset): DatasetConfig { id: f1509088-053c-4e9d-9899-1f2fa35f80ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f2dcb66c-1577-4845-bc9b-66aff796d72d (dataset): DatasetConfig { id: f2dcb66c-1577-4845-bc9b-66aff796d72d (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f73bc5fd-ee82-4b69-8235-b51779f39b48 (dataset): DatasetConfig { id: f73bc5fd-ee82-4b69-8235-b51779f39b48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f91e0a31-2bea-4834-8b3b-c94f28cdb6c5 (dataset): DatasetConfig { id: f91e0a31-2bea-4834-8b3b-c94f28cdb6c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9a6da96-1b6d-426e-b838-927139d4f68f (dataset): DatasetConfig { id: f9a6da96-1b6d-426e-b838-927139d4f68f (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe1c7483-de5e-4c59-b70e-dd6bdc3abb66 (dataset): DatasetConfig { id: fe1c7483-de5e-4c59-b70e-dd6bdc3abb66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe1deced-07c6-4326-9bd1-2c46d026f82f (dataset): DatasetConfig { id: fe1deced-07c6-4326-9bd1-2c46d026f82f (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4412024-12-13T22:58:20.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53914
4422024-12-13T22:58:20.416ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4432024-12-13T22:58:20.416ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {001fb0cd-bf54-4a29-ac44-00a316906a7a (dataset): DatasetConfig { id: 001fb0cd-bf54-4a29-ac44-00a316906a7a (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0512ec25-1dc1-4214-8edb-69e12bfad278 (dataset): DatasetConfig { id: 0512ec25-1dc1-4214-8edb-69e12bfad278 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08191ec0-f266-440f-bdb2-a3fb298dd626 (dataset): DatasetConfig { id: 08191ec0-f266-440f-bdb2-a3fb298dd626 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 10f3f2c2-e0c9-4c85-b609-d182ff3ddbdd (dataset): DatasetConfig { id: 10f3f2c2-e0c9-4c85-b609-d182ff3ddbdd (dataset), name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d836bd6-9bf2-483f-9ea1-b6820ff78ae4 (dataset): DatasetConfig { id: 1d836bd6-9bf2-483f-9ea1-b6820ff78ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 226b91b7-5dca-47b0-aa32-eedf06a5be32 (dataset): DatasetConfig { id: 226b91b7-5dca-47b0-aa32-eedf06a5be32 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27325b98-a923-4e85-a5cd-6f2ec271d209 (dataset): DatasetConfig { id: 27325b98-a923-4e85-a5cd-6f2ec271d209 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 294c1c38-a666-4094-98f9-40a27eaba4bb (dataset): DatasetConfig { id: 294c1c38-a666-4094-98f9-40a27eaba4bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29e41d3c-f2a4-403f-9dc1-12c267b402a8 (dataset): DatasetConfig { id: 29e41d3c-f2a4-403f-9dc1-12c267b402a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bd7e4c7-109a-4882-b1e1-bba983d2be15 (dataset): DatasetConfig { id: 2bd7e4c7-109a-4882-b1e1-bba983d2be15 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3547374a-938a-4510-b911-42a1566a263d (dataset): DatasetConfig { id: 3547374a-938a-4510-b911-42a1566a263d (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36ec72d3-ed7e-4da2-b0b6-0fb09752b316 (dataset): DatasetConfig { id: 36ec72d3-ed7e-4da2-b0b6-0fb09752b316 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a16b178-a276-49b2-8f65-52041a99bd8b (dataset): DatasetConfig { id: 3a16b178-a276-49b2-8f65-52041a99bd8b (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45111151-a90c-47be-8d40-205102c291d6 (dataset): DatasetConfig { id: 45111151-a90c-47be-8d40-205102c291d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45a86cc3-eef3-4499-900c-2df3d0593102 (dataset): DatasetConfig { id: 45a86cc3-eef3-4499-900c-2df3d0593102 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46448dad-7b6b-4afc-b479-d5d58f48464a (dataset): DatasetConfig { id: 46448dad-7b6b-4afc-b479-d5d58f48464a (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af2c683-1f09-4191-ba49-062e3eeb2836 (dataset): DatasetConfig { id: 4af2c683-1f09-4191-ba49-062e3eeb2836 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bee4697-4fd5-4a0a-a883-cdb37feae8d9 (dataset): DatasetConfig { id: 4bee4697-4fd5-4a0a-a883-cdb37feae8d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 509d770d-1da9-4253-84ca-baec93796415 (dataset): DatasetConfig { id: 509d770d-1da9-4253-84ca-baec93796415 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 543b5d1a-9957-4a1b-910c-1229d762a4e9 (dataset): DatasetConfig { id: 543b5d1a-9957-4a1b-910c-1229d762a4e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 568b92d6-59b3-420d-9c09-eee94fc56b47 (dataset): DatasetConfig { id: 568b92d6-59b3-420d-9c09-eee94fc56b47 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5fd80428-6850-4fdc-a8c1-b87c14f49dc5 (dataset): DatasetConfig { id: 5fd80428-6850-4fdc-a8c1-b87c14f49dc5 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 67fd861c-b52f-428e-b4f8-114ea68398e1 (dataset): DatasetConfig { id: 67fd861c-b52f-428e-b4f8-114ea68398e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 685885df-4f93-4e64-baf3-7e4fa6ef80b4 (dataset): DatasetConfig { id: 685885df-4f93-4e64-baf3-7e4fa6ef80b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ca23842-9e96-4193-ae25-c3f4d5f4e83a (dataset): DatasetConfig { id: 6ca23842-9e96-4193-ae25-c3f4d5f4e83a (dataset), name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7a516fa2-b580-4af6-a2b7-7d0b4ee77cba (dataset): DatasetConfig { id: 7a516fa2-b580-4af6-a2b7-7d0b4ee77cba (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7af4eca6-1056-4ea7-9e81-f3011113fa31 (dataset): DatasetConfig { id: 7af4eca6-1056-4ea7-9e81-f3011113fa31 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b2282c8-13fc-40c9-9bba-d894cab8aa86 (dataset): DatasetConfig { id: 7b2282c8-13fc-40c9-9bba-d894cab8aa86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82a247e0-5282-4fd9-aea7-1ed9d853028d (dataset): DatasetConfig { id: 82a247e0-5282-4fd9-aea7-1ed9d853028d (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 863c1163-c297-42db-a409-54145be09c58 (dataset): DatasetConfig { id: 863c1163-c297-42db-a409-54145be09c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86463141-e819-4b9d-a9ea-79e4a8290016 (dataset): DatasetConfig { id: 86463141-e819-4b9d-a9ea-79e4a8290016 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ea24e43-3f3a-4fc3-b8ca-0151a9a27f25 (dataset): DatasetConfig { id: 8ea24e43-3f3a-4fc3-b8ca-0151a9a27f25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9443ef3d-af15-4078-ab19-d3dd9cfbd551 (dataset): DatasetConfig { id: 9443ef3d-af15-4078-ab19-d3dd9cfbd551 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aaffb4ac-1975-48c1-bdea-2a9cf031a9de (dataset): DatasetConfig { id: aaffb4ac-1975-48c1-bdea-2a9cf031a9de (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab458b5a-263c-4c1d-a733-f146fca9b35d (dataset): DatasetConfig { id: ab458b5a-263c-4c1d-a733-f146fca9b35d (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b054e974-f734-44f4-8a5d-cfbab2c9d672 (dataset): DatasetConfig { id: b054e974-f734-44f4-8a5d-cfbab2c9d672 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6be62d5-249d-487c-b314-89c452bc1e37 (dataset): DatasetConfig { id: b6be62d5-249d-487c-b314-89c452bc1e37 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6fd3eaf-3b95-48b3-89a7-568aaaf30d34 (dataset): DatasetConfig { id: b6fd3eaf-3b95-48b3-89a7-568aaaf30d34 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bdd79a30-f41b-4378-be9f-dd2a1449a54c (dataset): DatasetConfig { id: bdd79a30-f41b-4378-be9f-dd2a1449a54c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf8f206f-2c62-4cf4-895b-0a3a91d80679 (dataset): DatasetConfig { id: bf8f206f-2c62-4cf4-895b-0a3a91d80679 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c36a6eea-31d4-444d-bcc9-a5b093a55d49 (dataset): DatasetConfig { id: c36a6eea-31d4-444d-bcc9-a5b093a55d49 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3b765d1-c0e3-47ec-bf2e-1c2c6b8d2a61 (dataset): DatasetConfig { id: c3b765d1-c0e3-47ec-bf2e-1c2c6b8d2a61 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c6be42b8-8ec2-4899-bbf9-d90ffd4b7d32 (dataset): DatasetConfig { id: c6be42b8-8ec2-4899-bbf9-d90ffd4b7d32 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c87d5976-44f1-45ca-a948-c0622d92a9c0 (dataset): DatasetConfig { id: c87d5976-44f1-45ca-a948-c0622d92a9c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c99908d4-7455-48c1-8daa-b6b08c808d83 (dataset): DatasetConfig { id: c99908d4-7455-48c1-8daa-b6b08c808d83 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce15b21d-4516-475a-b2eb-24ba587e1cca (dataset): DatasetConfig { id: ce15b21d-4516-475a-b2eb-24ba587e1cca (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d161b427-4c82-4661-b190-65cbf0f8e218 (dataset): DatasetConfig { id: d161b427-4c82-4661-b190-65cbf0f8e218 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1f323fe-10e0-433f-b523-89c35b719705 (dataset): DatasetConfig { id: d1f323fe-10e0-433f-b523-89c35b719705 (dataset), name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2a05747-11c1-49c7-991e-0fadbcd64fdb (dataset): DatasetConfig { id: d2a05747-11c1-49c7-991e-0fadbcd64fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3824f3c-1648-4733-b48f-871d10a82808 (dataset): DatasetConfig { id: d3824f3c-1648-4733-b48f-871d10a82808 (dataset), name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d657bc0a-c3af-4e17-aea2-38083c17faf7 (dataset): DatasetConfig { id: d657bc0a-c3af-4e17-aea2-38083c17faf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfc38796-8acd-4e4d-a954-aae83f963220 (dataset): DatasetConfig { id: dfc38796-8acd-4e4d-a954-aae83f963220 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0659a3a-7b4a-41de-915f-e74c4a7a154c (dataset): DatasetConfig { id: e0659a3a-7b4a-41de-915f-e74c4a7a154c (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e908ec56-4c89-4c16-841b-17ac55923c20 (dataset): DatasetConfig { id: e908ec56-4c89-4c16-841b-17ac55923c20 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea138aa6-57a3-49d2-bcf7-5f2793859a53 (dataset): DatasetConfig { id: ea138aa6-57a3-49d2-bcf7-5f2793859a53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea7c5907-d4ef-4702-b650-9eba7a6c4137 (dataset): DatasetConfig { id: ea7c5907-d4ef-4702-b650-9eba7a6c4137 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebd403d4-4ec5-4670-8e3b-0c01bb1aaeaf (dataset): DatasetConfig { id: ebd403d4-4ec5-4670-8e3b-0c01bb1aaeaf (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed300e5f-6334-4e62-a96c-3977e5894952 (dataset): DatasetConfig { id: ed300e5f-6334-4e62-a96c-3977e5894952 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee6f255e-a6e9-40d9-98d9-47a8ad6c27a7 (dataset): DatasetConfig { id: ee6f255e-a6e9-40d9-98d9-47a8ad6c27a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1509088-053c-4e9d-9899-1f2fa35f80ab (dataset): DatasetConfig { id: f1509088-053c-4e9d-9899-1f2fa35f80ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f2dcb66c-1577-4845-bc9b-66aff796d72d (dataset): DatasetConfig { id: f2dcb66c-1577-4845-bc9b-66aff796d72d (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f73bc5fd-ee82-4b69-8235-b51779f39b48 (dataset): DatasetConfig { id: f73bc5fd-ee82-4b69-8235-b51779f39b48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f91e0a31-2bea-4834-8b3b-c94f28cdb6c5 (dataset): DatasetConfig { id: f91e0a31-2bea-4834-8b3b-c94f28cdb6c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9a6da96-1b6d-426e-b838-927139d4f68f (dataset): DatasetConfig { id: f9a6da96-1b6d-426e-b838-927139d4f68f (dataset), name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe1c7483-de5e-4c59-b70e-dd6bdc3abb66 (dataset): DatasetConfig { id: fe1c7483-de5e-4c59-b70e-dd6bdc3abb66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe1deced-07c6-4326-9bd1-2c46d026f82f (dataset): DatasetConfig { id: fe1deced-07c6-4326-9bd1-2c46d026f82f (dataset), name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:606
4442024-12-13T22:58:20.416ZINFOSledAgent (StorageManager): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4452024-12-13T22:58:20.416ZINFOSledAgent (StorageManager): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462024-12-13T22:58:20.416ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:908 request = datasets_ensure
4472024-12-13T22:58:20.431ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4482024-12-13T22:58:20.431ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
4492024-12-13T22:58:20.431ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone" } file = sled-storage/src/manager.rs:1430
4502024-12-13T22:58:20.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4512024-12-13T22:58:20.459ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4522024-12-13T22:58:20.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/external_dns" } file = sled-storage/src/manager.rs:1430
4532024-12-13T22:58:20.505ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4542024-12-13T22:58:20.505ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
4552024-12-13T22:58:20.505ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66612a50-feea-47ce-a70f-e7d816b9348f/crypt/debug"), full_name: "oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crypt/debug" } file = sled-storage/src/manager.rs:1430
4562024-12-13T22:58:20.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4572024-12-13T22:58:20.531ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4582024-12-13T22:58:20.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785/crucible" } file = sled-storage/src/manager.rs:1430
4592024-12-13T22:58:20.578ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4602024-12-13T22:58:20.578ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4612024-12-13T22:58:20.578ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone/oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), full_name: "oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone/oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32" } file = sled-storage/src/manager.rs:1430
4622024-12-13T22:58:20.657ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4632024-12-13T22:58:20.657ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4642024-12-13T22:58:20.657ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7ecf842b-e498-4351-b151-8dff95453908/crypt/zone/oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749"), full_name: "oxp_7ecf842b-e498-4351-b151-8dff95453908/crypt/zone/oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749" } file = sled-storage/src/manager.rs:1430
4652024-12-13T22:58:20.715ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4662024-12-13T22:58:20.715ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4672024-12-13T22:58:20.715ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7ecf842b-e498-4351-b151-8dff95453908/crypt/zone/oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475"), full_name: "oxp_7ecf842b-e498-4351-b151-8dff95453908/crypt/zone/oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475" } file = sled-storage/src/manager.rs:1430
4682024-12-13T22:58:20.731ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/probe_manager.rs:231 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4692024-12-13T22:58:20.774ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4702024-12-13T22:58:20.774ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4712024-12-13T22:58:20.774ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7ecf842b-e498-4351-b151-8dff95453908/crucible" } file = sled-storage/src/manager.rs:1430
4722024-12-13T22:58:20.791ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 14.346414617s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
4732024-12-13T22:58:20.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4742024-12-13T22:58:20.825ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4752024-12-13T22:58:20.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27177673-3a08-4285-914d-2d0755afcc21/crypt/zone/oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7"), full_name: "oxp_27177673-3a08-4285-914d-2d0755afcc21/crypt/zone/oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7" } file = sled-storage/src/manager.rs:1430
4762024-12-13T22:58:20.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4772024-12-13T22:58:20.884ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
4782024-12-13T22:58:20.884ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7ecf842b-e498-4351-b151-8dff95453908/crypt/debug"), full_name: "oxp_7ecf842b-e498-4351-b151-8dff95453908/crypt/debug" } file = sled-storage/src/manager.rs:1430
4792024-12-13T22:58:20.912ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4802024-12-13T22:58:20.912ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4812024-12-13T22:58:20.912ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/zone/oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76"), full_name: "oxp_46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/zone/oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76" } file = sled-storage/src/manager.rs:1430
4822024-12-13T22:58:20.970ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4832024-12-13T22:58:20.970ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4842024-12-13T22:58:20.970ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone/oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1"), full_name: "oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone/oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1" } file = sled-storage/src/manager.rs:1430
4852024-12-13T22:58:21.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4862024-12-13T22:58:21.031ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4872024-12-13T22:58:21.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/zone/oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0"), full_name: "oxp_46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/zone/oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0" } file = sled-storage/src/manager.rs:1430
4882024-12-13T22:58:21.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4892024-12-13T22:58:21.092ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4902024-12-13T22:58:21.092ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1430
4912024-12-13T22:58:21.144ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4922024-12-13T22:58:21.144ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4932024-12-13T22:58:21.144ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone/oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), full_name: "oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone/oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662" } file = sled-storage/src/manager.rs:1430
4942024-12-13T22:58:21.205ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4952024-12-13T22:58:21.205ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
4962024-12-13T22:58:21.205ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27177673-3a08-4285-914d-2d0755afcc21/crypt/zone"), full_name: "oxp_27177673-3a08-4285-914d-2d0755afcc21/crypt/zone" } file = sled-storage/src/manager.rs:1430
4972024-12-13T22:58:21.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
4982024-12-13T22:58:21.235ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
4992024-12-13T22:58:21.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_27177673-3a08-4285-914d-2d0755afcc21/crucible" } file = sled-storage/src/manager.rs:1430
5002024-12-13T22:58:21.283ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5012024-12-13T22:58:21.283ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5022024-12-13T22:58:21.283ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27177673-3a08-4285-914d-2d0755afcc21/crypt/debug"), full_name: "oxp_27177673-3a08-4285-914d-2d0755afcc21/crypt/debug" } file = sled-storage/src/manager.rs:1430
5032024-12-13T22:58:21.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5042024-12-13T22:58:21.312ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5052024-12-13T22:58:21.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone"), full_name: "oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone" } file = sled-storage/src/manager.rs:1430
5062024-12-13T22:58:21.341ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5072024-12-13T22:58:21.341ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5082024-12-13T22:58:21.341ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/debug"), full_name: "oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/debug" } file = sled-storage/src/manager.rs:1430
5092024-12-13T22:58:21.369ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5102024-12-13T22:58:21.369ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5112024-12-13T22:58:21.369ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/debug"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/debug" } file = sled-storage/src/manager.rs:1430
5122024-12-13T22:58:21.397ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5132024-12-13T22:58:21.398ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5142024-12-13T22:58:21.398ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/external_dns" } file = sled-storage/src/manager.rs:1430
5152024-12-13T22:58:21.446ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5162024-12-13T22:58:21.446ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5172024-12-13T22:58:21.446ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone/oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone/oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43" } file = sled-storage/src/manager.rs:1430
5182024-12-13T22:58:21.504ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5192024-12-13T22:58:21.504ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5202024-12-13T22:58:21.504ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crucible" } file = sled-storage/src/manager.rs:1430
5212024-12-13T22:58:21.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5222024-12-13T22:58:21.552ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5232024-12-13T22:58:21.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/250b1dc6-2f04-40c0-aa88-b25ceadf6785/crypt/debug"), full_name: "oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785/crypt/debug" } file = sled-storage/src/manager.rs:1430
5242024-12-13T22:58:21.582ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5252024-12-13T22:58:21.582ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5262024-12-13T22:58:21.582ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27177673-3a08-4285-914d-2d0755afcc21/crypt/zone/oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f"), full_name: "oxp_27177673-3a08-4285-914d-2d0755afcc21/crypt/zone/oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f" } file = sled-storage/src/manager.rs:1430
5272024-12-13T22:58:21.639ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5282024-12-13T22:58:21.639ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5292024-12-13T22:58:21.639ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone"), full_name: "oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone" } file = sled-storage/src/manager.rs:1430
5302024-12-13T22:58:21.668ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5312024-12-13T22:58:21.668ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5322024-12-13T22:58:21.668ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7ecf842b-e498-4351-b151-8dff95453908/crypt/internal_dns" } file = sled-storage/src/manager.rs:1430
5332024-12-13T22:58:21.719ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5342024-12-13T22:58:21.719ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5352024-12-13T22:58:21.719ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone/oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), full_name: "oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone/oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5" } file = sled-storage/src/manager.rs:1430
5362024-12-13T22:58:21.734ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/probe_manager.rs:231 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
5372024-12-13T22:58:21.778ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5382024-12-13T22:58:21.778ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5392024-12-13T22:58:21.778ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crucible" } file = sled-storage/src/manager.rs:1430
5402024-12-13T22:58:21.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5412024-12-13T22:58:21.825ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5422024-12-13T22:58:21.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_46df782d-5e10-4410-8b6c-9b413351c0ef/crucible" } file = sled-storage/src/manager.rs:1430
5432024-12-13T22:58:21.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5442024-12-13T22:58:21.875ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5452024-12-13T22:58:21.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_27177673-3a08-4285-914d-2d0755afcc21/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1430
5462024-12-13T22:58:21.925ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5472024-12-13T22:58:21.925ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5482024-12-13T22:58:21.925ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695" } file = sled-storage/src/manager.rs:1430
5492024-12-13T22:58:21.986ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5502024-12-13T22:58:21.986ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5512024-12-13T22:58:21.986ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crypt/zone/oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153"), full_name: "oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crypt/zone/oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153" } file = sled-storage/src/manager.rs:1430
5522024-12-13T22:58:22.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5532024-12-13T22:58:22.046ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5542024-12-13T22:58:22.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1430
5552024-12-13T22:58:22.098ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5562024-12-13T22:58:22.098ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5572024-12-13T22:58:22.098ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92" } file = sled-storage/src/manager.rs:1430
5582024-12-13T22:58:22.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5592024-12-13T22:58:22.156ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5602024-12-13T22:58:22.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/internal_dns" } file = sled-storage/src/manager.rs:1430
5612024-12-13T22:58:22.205ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5622024-12-13T22:58:22.205ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5632024-12-13T22:58:22.205ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf" } file = sled-storage/src/manager.rs:1430
5642024-12-13T22:58:22.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5652024-12-13T22:58:22.264ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5662024-12-13T22:58:22.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7ecf842b-e498-4351-b151-8dff95453908/crypt/zone"), full_name: "oxp_7ecf842b-e498-4351-b151-8dff95453908/crypt/zone" } file = sled-storage/src/manager.rs:1430
5672024-12-13T22:58:22.295ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5682024-12-13T22:58:22.295ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5692024-12-13T22:58:22.295ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb" } file = sled-storage/src/manager.rs:1430
5702024-12-13T22:58:22.355ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5712024-12-13T22:58:22.355ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5722024-12-13T22:58:22.355ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone/oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone/oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150" } file = sled-storage/src/manager.rs:1430
5732024-12-13T22:58:22.414ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5742024-12-13T22:58:22.414ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5752024-12-13T22:58:22.414ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/debug"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/debug" } file = sled-storage/src/manager.rs:1430
5762024-12-13T22:58:22.442ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5772024-12-13T22:58:22.442ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5782024-12-13T22:58:22.442ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible" } file = sled-storage/src/manager.rs:1430
5792024-12-13T22:58:22.492ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5802024-12-13T22:58:22.492ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5812024-12-13T22:58:22.492ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone/oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942"), full_name: "oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone/oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942" } file = sled-storage/src/manager.rs:1430
5822024-12-13T22:58:22.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5832024-12-13T22:58:22.552ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5842024-12-13T22:58:22.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone/oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone/oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24" } file = sled-storage/src/manager.rs:1430
5852024-12-13T22:58:22.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5862024-12-13T22:58:22.612ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5872024-12-13T22:58:22.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/debug"), full_name: "oxp_46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/debug" } file = sled-storage/src/manager.rs:1430
5882024-12-13T22:58:22.640ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5892024-12-13T22:58:22.640ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
5902024-12-13T22:58:22.640ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b" } file = sled-storage/src/manager.rs:1430
5912024-12-13T22:58:22.702ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5922024-12-13T22:58:22.702ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5932024-12-13T22:58:22.702ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/250b1dc6-2f04-40c0-aa88-b25ceadf6785/crypt/zone"), full_name: "oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785/crypt/zone" } file = sled-storage/src/manager.rs:1430
5942024-12-13T22:58:22.732ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5952024-12-13T22:58:22.732ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
5962024-12-13T22:58:22.732ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/zone"), full_name: "oxp_46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/zone" } file = sled-storage/src/manager.rs:1430
5972024-12-13T22:58:22.736ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/probe_manager.rs:231 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
5982024-12-13T22:58:22.761ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
5992024-12-13T22:58:22.761ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6002024-12-13T22:58:22.761ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/250b1dc6-2f04-40c0-aa88-b25ceadf6785/crypt/zone/oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d"), full_name: "oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785/crypt/zone/oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d" } file = sled-storage/src/manager.rs:1430
6012024-12-13T22:58:22.819ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6022024-12-13T22:58:22.819ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6032024-12-13T22:58:22.819ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/clickhouse" } file = sled-storage/src/manager.rs:1430
6042024-12-13T22:58:22.869ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6052024-12-13T22:58:22.869ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
6062024-12-13T22:58:22.869ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crypt/zone"), full_name: "oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crypt/zone" } file = sled-storage/src/manager.rs:1430
6072024-12-13T22:58:22.898ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6082024-12-13T22:58:22.898ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6092024-12-13T22:58:22.898ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1430
6102024-12-13T22:58:22.949ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6112024-12-13T22:58:22.949ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6122024-12-13T22:58:22.949ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone/oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f"), full_name: "oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone/oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f" } file = sled-storage/src/manager.rs:1430
6132024-12-13T22:58:23.010ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6142024-12-13T22:58:23.010ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6152024-12-13T22:58:23.010ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7ecf842b-e498-4351-b151-8dff95453908/crypt/zone/oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e"), full_name: "oxp_7ecf842b-e498-4351-b151-8dff95453908/crypt/zone/oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e" } file = sled-storage/src/manager.rs:1430
6162024-12-13T22:58:23.072ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6172024-12-13T22:58:23.072ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6182024-12-13T22:58:23.072ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crucible" } file = sled-storage/src/manager.rs:1430
6192024-12-13T22:58:23.121ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6202024-12-13T22:58:23.121ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6212024-12-13T22:58:23.121ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone/oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0" } file = sled-storage/src/manager.rs:1430
6222024-12-13T22:58:23.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6232024-12-13T22:58:23.182ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
6242024-12-13T22:58:23.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone"), full_name: "oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/zone" } file = sled-storage/src/manager.rs:1430
6252024-12-13T22:58:23.211ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6262024-12-13T22:58:23.211ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6272024-12-13T22:58:23.211ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crucible" } file = sled-storage/src/manager.rs:1430
6282024-12-13T22:58:23.260ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6292024-12-13T22:58:23.260ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:997 request = datasets_ensure
6302024-12-13T22:58:23.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crypt/debug"), full_name: "oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crypt/debug" } file = sled-storage/src/manager.rs:1430
6312024-12-13T22:58:23.290ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6322024-12-13T22:58:23.290ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6332024-12-13T22:58:23.290ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone/oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/zone/oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0" } file = sled-storage/src/manager.rs:1430
6342024-12-13T22:58:23.351ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6352024-12-13T22:58:23.351ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6362024-12-13T22:58:23.351ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7ecf842b-e498-4351-b151-8dff95453908/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1430
6372024-12-13T22:58:23.401ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6382024-12-13T22:58:23.401ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6392024-12-13T22:58:23.401ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1430
6402024-12-13T22:58:23.450ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6412024-12-13T22:58:23.450ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6422024-12-13T22:58:23.450ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27177673-3a08-4285-914d-2d0755afcc21/crypt/zone/oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f"), full_name: "oxp_27177673-3a08-4285-914d-2d0755afcc21/crypt/zone/oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f" } file = sled-storage/src/manager.rs:1430
6432024-12-13T22:58:23.510ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6442024-12-13T22:58:23.510ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6452024-12-13T22:58:23.510ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone/oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e"), full_name: "oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crypt/zone/oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e" } file = sled-storage/src/manager.rs:1430
6462024-12-13T22:58:23.574ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1038 request = datasets_ensure
6472024-12-13T22:58:23.574ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:992 request = datasets_ensure
6482024-12-13T22:58:23.574ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone/oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8"), full_name: "oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/zone/oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8" } file = sled-storage/src/manager.rs:1430
6492024-12-13T22:58:23.634ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6502024-12-13T22:58:23.635ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512024-12-13T22:58:23.635ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
6522024-12-13T22:58:23.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3219338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53914 req_id = 77c24dc2-f46d-42f2-b29a-e42e64852f53 response_code = 200 uri = /datasets
6532024-12-13T22:58:23.667ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: b88c164b-e402-4ec9-9363-11d16ca7dbdf (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24 (service), filesystem_pool: Some(ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749 (service), filesystem_pool: Some(ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6542024-12-13T22:58:23.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48642
6552024-12-13T22:58:23.667ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b88c164b-e402-4ec9-9363-11d16ca7dbdf, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
6562024-12-13T22:58:23.667ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: b88c164b-e402-4ec9-9363-11d16ca7dbdf, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6572024-12-13T22:58:23.713ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
6582024-12-13T22:58:23.713ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592024-12-13T22:58:23.739ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/probe_manager.rs:231 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
6602024-12-13T22:58:23.757ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
6612024-12-13T22:58:23.757ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622024-12-13T22:58:23.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
6632024-12-13T22:58:23.803ZINFOSledAgent (ServiceManager): No ledger in /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:188
6642024-12-13T22:58:23.803ZINFOSledAgent (ServiceManager): No ledger in /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:188
6652024-12-13T22:58:23.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
6662024-12-13T22:58:23.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
6672024-12-13T22:58:23.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
6682024-12-13T22:58:23.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
6692024-12-13T22:58:23.898ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf file = illumos-utils/src/zone.rs:325
6702024-12-13T22:58:23.902ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24 file = illumos-utils/src/zone.rs:325
6712024-12-13T22:58:23.906ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749 file = illumos-utils/src/zone.rs:325
6722024-12-13T22:58:23.919ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf file = illumos-utils/src/zone.rs:363
6732024-12-13T22:58:23.923ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24 file = illumos-utils/src/zone.rs:363
6742024-12-13T22:58:23.927ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749 file = illumos-utils/src/zone.rs:363
6752024-12-13T22:58:24.742ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c991c27b-85ad-498c-8a93-464bd3ce406f) file = sled-agent/src/probe_manager.rs:231 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
6762024-12-13T22:58:25.577ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6772024-12-13T22:58:25.577ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6782024-12-13T22:58:25.577ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
6792024-12-13T22:58:26.065ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-12-13T22:58:26.545ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6812024-12-13T22:58:26.545ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-12-13T22:58:26.545ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6832024-12-13T22:58:26.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 57.795032ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
6842024-12-13T22:58:26.554ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
6852024-12-13T22:58:26.558ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
6862024-12-13T22:58:26.564ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8560032199437178366 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
6872024-12-13T22:58:26.565ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3199594145898649564 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
6882024-12-13T22:58:26.576ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
6892024-12-13T22:58:26.576ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
6902024-12-13T22:58:26.583ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6912024-12-13T22:58:26.583ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6922024-12-13T22:58:26.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 91.210524ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
6932024-12-13T22:58:26.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 38.55239ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
6942024-12-13T22:58:26.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 43.06449ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
6952024-12-13T22:58:26.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 186.593774ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
6962024-12-13T22:58:26.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 70.993418ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
6972024-12-13T22:58:26.743ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6982024-12-13T22:58:26.743ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6992024-12-13T22:58:26.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 52.174861ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7002024-12-13T22:58:27.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 162.502103ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
7012024-12-13T22:58:27.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 198.354183ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7022024-12-13T22:58:27.076ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
7032024-12-13T22:58:27.076ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
7042024-12-13T22:58:27.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 354.760737ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
7052024-12-13T22:58:27.202ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
7062024-12-13T22:58:27.202ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
7072024-12-13T22:58:27.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 593.411591ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
7082024-12-13T22:58:27.226ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
7092024-12-13T22:58:27.226ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
7102024-12-13T22:58:27.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 208.447435ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7112024-12-13T22:58:27.300ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
7122024-12-13T22:58:27.301ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
7132024-12-13T22:58:27.406ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
7142024-12-13T22:58:27.406ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7152024-12-13T22:58:27.445ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7162024-12-13T22:58:27.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 987.144993ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
7172024-12-13T22:58:27.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 669.616017ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7182024-12-13T22:58:27.482ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7192024-12-13T22:58:27.482ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7202024-12-13T22:58:27.483ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7212024-12-13T22:58:27.483ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7222024-12-13T22:58:27.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
7232024-12-13T22:58:27.571ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:606
7242024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7252024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7272024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7282024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7292024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7312024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7332024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7352024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7372024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7392024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7412024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7432024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7452024-12-13T22:58:27.571ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462024-12-13T22:58:27.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 995157440737059926 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
7472024-12-13T22:58:27.727ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4994363618683968739 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
7482024-12-13T22:58:27.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 689.558559ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
7492024-12-13T22:58:28.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 1.07534216s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7502024-12-13T22:58:28.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 886.854133ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
7512024-12-13T22:58:28.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 753.875605ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
7522024-12-13T22:58:29.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 1.281465564s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7532024-12-13T22:58:29.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 1.264288265s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
7542024-12-13T22:58:29.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 898.294738ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
7552024-12-13T22:58:30.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 697.241718ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
7562024-12-13T22:58:30.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 720.53296ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7572024-12-13T22:58:30.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 1.433210894s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
7582024-12-13T22:58:30.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 993.892429ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
7592024-12-13T22:58:31.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 626.980767ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7602024-12-13T22:58:31.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749") failed: Property not found. retry in 961.326599ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7612024-12-13T22:58:31.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf") failed: Property not found. retry in 817.207898ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
7622024-12-13T22:58:31.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24") failed: Property not found. retry in 1.334651158s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
7632024-12-13T22:58:33.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_b88c164b-e402-4ec9-9363-11d16ca7dbdf
7642024-12-13T22:58:33.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_20fde3a4-5e95-4e74-ba1d-0071f7323c24
7652024-12-13T22:58:33.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_1e33e0af-aaa2-488b-a8e8-43c2cb761749
7662024-12-13T22:58:33.339ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672024-12-13T22:58:33.339ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682024-12-13T22:58:33.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9672030 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48642 req_id = 79cd9fea-ce56-4500-92ea-7badda69f585 response_code = 204 uri = /omicron-zones
7692024-12-13T22:58:33.341ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702024-12-13T22:58:33.828ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 76.601496ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7712024-12-13T22:58:33.906ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 91.202825ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7722024-12-13T22:58:34.047ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732024-12-13T22:58:34.111ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 73.214375ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7742024-12-13T22:58:34.185ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 129.730216ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7752024-12-13T22:58:34.354ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7762024-12-13T22:58:34.418ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7772024-12-13T22:58:34.418ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7782024-12-13T22:58:34.449ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7792024-12-13T22:58:34.450ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7802024-12-13T22:58:34.450ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7812024-12-13T22:58:34.479ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: b88c164b-e402-4ec9-9363-11d16ca7dbdf (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24 (service), filesystem_pool: Some(ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749 (service), filesystem_pool: Some(ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f (service), filesystem_pool: Some(ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eb37b437-c7d8-494a-8f33-40ad21b73e11, kind: Service { id: 0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f }, name: Name("ntp-0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 59])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7822024-12-13T22:58:34.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40739
7832024-12-13T22:58:34.480ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b88c164b-e402-4ec9-9363-11d16ca7dbdf, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
7842024-12-13T22:58:34.480ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: b88c164b-e402-4ec9-9363-11d16ca7dbdf, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7852024-12-13T22:58:34.546ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
7862024-12-13T22:58:34.546ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7872024-12-13T22:58:34.612ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
7882024-12-13T22:58:34.612ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7892024-12-13T22:58:34.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
7902024-12-13T22:58:34.672ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:177
7912024-12-13T22:58:34.672ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:177
7922024-12-13T22:58:34.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
7932024-12-13T22:58:34.682ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7942024-12-13T22:58:34.715ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7952024-12-13T22:58:34.717ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7962024-12-13T22:58:34.717ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7972024-12-13T22:58:34.748ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 237, 59]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7982024-12-13T22:58:34.748ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7992024-12-13T22:58:34.748ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
8002024-12-13T22:58:34.748ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
8012024-12-13T22:58:34.748ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8022024-12-13T22:58:34.749ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
8032024-12-13T22:58:34.775ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f file = illumos-utils/src/zone.rs:325
8042024-12-13T22:58:34.792ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f file = illumos-utils/src/zone.rs:363
8052024-12-13T22:58:35.406ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8062024-12-13T22:58:35.406ZINFOSledAgent (ServiceManager): Booting oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8072024-12-13T22:58:35.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 39.923724ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8082024-12-13T22:58:35.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 74.216161ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8092024-12-13T22:58:35.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 133.704378ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8102024-12-13T22:58:35.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 490.513874ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8112024-12-13T22:58:36.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 772.921592ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8122024-12-13T22:58:36.566ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8560032199437178366 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8132024-12-13T22:58:36.567ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3199594145898649564 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8142024-12-13T22:58:37.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 1.134446363s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8152024-12-13T22:58:37.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 995157440737059926 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8162024-12-13T22:58:37.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4994363618683968739 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8172024-12-13T22:58:38.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 1.104574661s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8182024-12-13T22:58:39.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 1.165934832s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8192024-12-13T22:58:40.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f") failed: Property not found. retry in 1.122834732s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8202024-12-13T22:58:41.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f
8212024-12-13T22:58:41.683ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8222024-12-13T22:58:41.683ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8232024-12-13T22:58:41.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7203983 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40739 req_id = f7a4350b-2f57-4ce3-af21-85afe8cf4eb4 response_code = 204 uri = /omicron-zones
8242024-12-13T22:58:41.686ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8252024-12-13T22:58:41.716ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262024-12-13T22:58:41.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44452
8272024-12-13T22:58:41.725ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8282024-12-13T22:58:41.725ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8712 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44452 req_id = f4a93154-53e9-4d11-a4c1-ec43f1500ce5 response_code = 500 uri = /timesync
8292024-12-13T22:58:41.727ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8302024-12-13T22:58:41.858ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8312024-12-13T22:58:41.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41969
8322024-12-13T22:58:42.799ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5946230298026914374 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8332024-12-13T22:58:42.879ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17553915529472961952 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8342024-12-13T22:58:43.342ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 168642061671920214 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8352024-12-13T22:58:45.866ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8362024-12-13T22:58:45.867ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008062 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41969 req_id = 960c878f-74b3-4ad3-8dfb-968a62a12747 response_code = 500 uri = /timesync
8372024-12-13T22:58:45.869ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382024-12-13T22:58:45.970ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8392024-12-13T22:58:45.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52804
8402024-12-13T22:58:45.979ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8412024-12-13T22:58:45.979ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8543 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52804 req_id = 48a52853-a771-4378-b4f7-69d8d6774efd response_code = 500 uri = /timesync
8422024-12-13T22:58:45.981ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8432024-12-13T22:58:46.099ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8442024-12-13T22:58:46.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40881
8452024-12-13T22:58:46.569ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8560032199437178366 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8462024-12-13T22:58:46.569ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3199594145898649564 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8472024-12-13T22:58:47.731ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 995157440737059926 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8482024-12-13T22:58:47.732ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4994363618683968739 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8492024-12-13T22:58:50.107ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8502024-12-13T22:58:50.107ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008041 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40881 req_id = b4b89815-8f2e-4b2b-95a0-0201929120b7 response_code = 500 uri = /timesync
8512024-12-13T22:58:50.110ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8522024-12-13T22:58:50.176ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 173.775352ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8532024-12-13T22:58:50.313ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542024-12-13T22:58:50.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60929
8552024-12-13T22:58:50.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8976 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60929 req_id = a50b3ae8-bf08-44f0-969f-a6994be82ff0 response_code = 200 uri = /timesync
8562024-12-13T22:58:50.325ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.073404171 } file = sled-agent/src/rack_setup/service.rs:743
8572024-12-13T22:58:50.325ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582024-12-13T22:58:50.524ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592024-12-13T22:58:50.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36320
8602024-12-13T22:58:50.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36320 req_id = 357749f3-fbe5-4e89-9a3c-ad2e6afa8b7b response_code = 200 uri = /timesync
8612024-12-13T22:58:50.536ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.074331708 } file = sled-agent/src/rack_setup/service.rs:743
8622024-12-13T22:58:50.536ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632024-12-13T22:58:50.899ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642024-12-13T22:58:50.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44379
8652024-12-13T22:58:50.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44379 req_id = a4b2666a-c255-49e2-bae0-ed08a00353d7 response_code = 200 uri = /timesync
8662024-12-13T22:58:50.910ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.073318437 } file = sled-agent/src/rack_setup/service.rs:743
8672024-12-13T22:58:50.910ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682024-12-13T22:58:51.181ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692024-12-13T22:58:51.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54763
8702024-12-13T22:58:51.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7969 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54763 req_id = ad74c0af-8f59-4ad8-9212-b178c5141417 response_code = 200 uri = /timesync
8712024-12-13T22:58:51.192ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.072558783 } file = sled-agent/src/rack_setup/service.rs:743
8722024-12-13T22:58:51.192ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732024-12-13T22:58:51.560ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742024-12-13T22:58:51.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52965
8752024-12-13T22:58:51.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8772 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52965 req_id = 535ac378-8ea5-45f1-b422-76f49acb8718 response_code = 200 uri = /timesync
8762024-12-13T22:58:51.571ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.072142512 } file = sled-agent/src/rack_setup/service.rs:743
8772024-12-13T22:58:51.571ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782024-12-13T22:58:51.691ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10596263815409644653 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8792024-12-13T22:58:51.691ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18410773930267545313 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8802024-12-13T22:58:51.922ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812024-12-13T22:58:51.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33915
8822024-12-13T22:58:51.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7897 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33915 req_id = 2aa39af6-23b5-4f3c-9a7e-a1824630526e response_code = 200 uri = /timesync
8832024-12-13T22:58:51.932ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.071166471 } file = sled-agent/src/rack_setup/service.rs:743
8842024-12-13T22:58:51.932ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852024-12-13T22:58:52.260ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8862024-12-13T22:58:52.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46431
8872024-12-13T22:58:52.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8423 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46431 req_id = ad87f56c-3d4f-4a35-a7be-4ad21fb80878 response_code = 200 uri = /timesync
8882024-12-13T22:58:52.271ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.070252351 } file = sled-agent/src/rack_setup/service.rs:743
8892024-12-13T22:58:52.271ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8902024-12-13T22:58:52.631ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8912024-12-13T22:58:52.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50336
8922024-12-13T22:58:52.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50336 req_id = bdc3f019-bc7a-452e-b0d9-2dc59d537f45 response_code = 200 uri = /timesync
8932024-12-13T22:58:52.644ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.069702476 } file = sled-agent/src/rack_setup/service.rs:743
8942024-12-13T22:58:52.644ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8952024-12-13T22:58:52.809ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5946230298026914374 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8962024-12-13T22:58:52.887ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17553915529472961952 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
8972024-12-13T22:58:53.290ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8982024-12-13T22:58:53.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61048
8992024-12-13T22:58:53.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61048 req_id = 178691ac-f239-4a05-a011-4626af48861c response_code = 200 uri = /timesync
9002024-12-13T22:58:53.303ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734130728.0044205, correction: 0.067924455 } file = sled-agent/src/rack_setup/service.rs:743
9012024-12-13T22:58:53.303ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9022024-12-13T22:58:53.354ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 168642061671920214 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
9032024-12-13T22:58:53.912ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9042024-12-13T22:58:53.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46582
9052024-12-13T22:58:53.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8373 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46582 req_id = 5c02e903-300c-4483-b478-ad0e509040d8 response_code = 200 uri = /timesync
9062024-12-13T22:58:53.922ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1734130732.7236602, correction: 0.066541411 } file = sled-agent/src/rack_setup/service.rs:743
9072024-12-13T22:58:53.922ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9082024-12-13T22:58:55.474ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9092024-12-13T22:58:55.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50217
9102024-12-13T22:58:55.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8373 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50217 req_id = 16ca6816-0247-4aaa-b73f-c79fdce34cd9 response_code = 200 uri = /timesync
9112024-12-13T22:58:55.487ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1734130734.695329, correction: 0.060320597 } file = sled-agent/src/rack_setup/service.rs:743
9122024-12-13T22:58:55.487ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9132024-12-13T22:58:56.544ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9142024-12-13T22:58:56.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33206
9152024-12-13T22:58:56.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8584 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33206 req_id = 6fb13baf-8d51-463b-a43c-1117436f9392 response_code = 200 uri = /timesync
9162024-12-13T22:58:56.555ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1734130736.102302, correction: 0.057237811 } file = sled-agent/src/rack_setup/service.rs:743
9172024-12-13T22:58:56.555ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9182024-12-13T22:58:56.591ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8560032199437178366 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
9192024-12-13T22:58:56.591ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3199594145898649564 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
9202024-12-13T22:58:56.817ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49339
9212024-12-13T22:58:56.817ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49339 req_id = d06d5a86-c96a-4972-8c78-eca01733ff04 response_code = 200 uri = /baseboard
9222024-12-13T22:58:57.756ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 995157440737059926 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
9232024-12-13T22:58:57.756ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4994363618683968739 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
9242024-12-13T22:58:57.893ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9252024-12-13T22:58:57.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40880
9262024-12-13T22:58:57.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9786 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40880 req_id = 6c01936d-2cc1-4ec8-93dc-8dfc324d15bb response_code = 200 uri = /timesync
9272024-12-13T22:58:57.905ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1734130737.4158485, correction: 0.053423092 } file = sled-agent/src/rack_setup/service.rs:743
9282024-12-13T22:58:57.905ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9292024-12-13T22:59:00.526ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9302024-12-13T22:59:00.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42456
9312024-12-13T22:59:00.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20754 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42456 req_id = 75a932a9-7eeb-4e3a-a71e-cb895e519191 response_code = 200 uri = /timesync
9322024-12-13T22:59:00.552ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1734130739.642358, correction: 0.046130583 } file = sled-agent/src/rack_setup/service.rs:743
9332024-12-13T22:59:00.552ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9342024-12-13T22:59:00.583ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: b88c164b-e402-4ec9-9363-11d16ca7dbdf (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24 (service), filesystem_pool: Some(ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749 (service), filesystem_pool: Some(ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f (service), filesystem_pool: Some(ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eb37b437-c7d8-494a-8f33-40ad21b73e11, kind: Service { id: 0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f }, name: Name("ntp-0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 59])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: eafb0c5f-d0bb-400e-8ad3-b8972401d5eb (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } } } }, OmicronZoneConfig { id: f30b25b2-d13e-43ec-89e0-6c5ea663c5c0 (service), filesystem_pool: Some(ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } } } }, OmicronZoneConfig { id: 133f4f0a-5893-4080-8b87-7329d1571a5e (service), filesystem_pool: Some(ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External } } } }, OmicronZoneConfig { id: a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f (service), filesystem_pool: Some(ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External } } } }, OmicronZoneConfig { id: e862e238-b979-4849-90fc-5e881fb5b5c1 (service), filesystem_pool: Some(ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9352024-12-13T22:59:00.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55579
9362024-12-13T22:59:00.584ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b88c164b-e402-4ec9-9363-11d16ca7dbdf, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
9372024-12-13T22:59:00.584ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: b88c164b-e402-4ec9-9363-11d16ca7dbdf, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, responder: ... }
9382024-12-13T22:59:00.639ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
9392024-12-13T22:59:00.639ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, responder: ... }
9402024-12-13T22:59:00.691ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
9412024-12-13T22:59:00.691ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9422024-12-13T22:59:00.741ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eafb0c5f-d0bb-400e-8ad3-b8972401d5eb, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
9432024-12-13T22:59:00.741ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: eafb0c5f-d0bb-400e-8ad3-b8972401d5eb, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Cockroach }, responder: ... }
9442024-12-13T22:59:00.795ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f30b25b2-d13e-43ec-89e0-6c5ea663c5c0, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
9452024-12-13T22:59:00.795ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: f30b25b2-d13e-43ec-89e0-6c5ea663c5c0, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Cockroach }, responder: ... }
9462024-12-13T22:59:00.847ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 133f4f0a-5893-4080-8b87-7329d1571a5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
9472024-12-13T22:59:00.847ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 133f4f0a-5893-4080-8b87-7329d1571a5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9482024-12-13T22:59:00.901ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f, dataset_name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
9492024-12-13T22:59:00.901ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f, dataset_name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9502024-12-13T22:59:00.954ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e862e238-b979-4849-90fc-5e881fb5b5c1, dataset_name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
9512024-12-13T22:59:00.954ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: e862e238-b979-4849-90fc-5e881fb5b5c1, dataset_name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Cockroach }, responder: ... }
9522024-12-13T22:59:01.006ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
9532024-12-13T22:59:01.006ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:177
9542024-12-13T22:59:01.007ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:177
9552024-12-13T22:59:01.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
9562024-12-13T22:59:01.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
9572024-12-13T22:59:01.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
9582024-12-13T22:59:01.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
9592024-12-13T22:59:01.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
9602024-12-13T22:59:01.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
9612024-12-13T22:59:01.182ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e file = illumos-utils/src/zone.rs:325
9622024-12-13T22:59:01.187ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb file = illumos-utils/src/zone.rs:325
9632024-12-13T22:59:01.191ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0 file = illumos-utils/src/zone.rs:325
9642024-12-13T22:59:01.195ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1 file = illumos-utils/src/zone.rs:325
9652024-12-13T22:59:01.200ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f file = illumos-utils/src/zone.rs:325
9662024-12-13T22:59:01.204ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e file = illumos-utils/src/zone.rs:363
9672024-12-13T22:59:01.209ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb file = illumos-utils/src/zone.rs:363
9682024-12-13T22:59:01.213ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0 file = illumos-utils/src/zone.rs:363
9692024-12-13T22:59:01.218ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1 file = illumos-utils/src/zone.rs:363
9702024-12-13T22:59:01.222ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f file = illumos-utils/src/zone.rs:363
9712024-12-13T22:59:04.119ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f30b25b2-d13e-43ec-89e0-6c5ea663c5c0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9722024-12-13T22:59:04.119ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
9732024-12-13T22:59:04.136ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9742024-12-13T22:59:04.137ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
9752024-12-13T22:59:04.195ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='133f4f0a-5893-4080-8b87-7329d1571a5e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9762024-12-13T22:59:04.195ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e862e238-b979-4849-90fc-5e881fb5b5c1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9772024-12-13T22:59:04.195ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
9782024-12-13T22:59:04.200ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
9792024-12-13T22:59:04.252ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='eafb0c5f-d0bb-400e-8ad3-b8972401d5eb'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9802024-12-13T22:59:04.252ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
9812024-12-13T22:59:04.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 63.850454ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
9822024-12-13T22:59:04.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 54.052476ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
9832024-12-13T22:59:04.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 45.834083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
9842024-12-13T22:59:04.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 100.031948ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
9852024-12-13T22:59:04.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 48.327994ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
9862024-12-13T22:59:04.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 93.568893ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
9872024-12-13T22:59:04.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 68.273251ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
9882024-12-13T22:59:05.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 33.531268ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
9892024-12-13T22:59:05.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 255.243458ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
9902024-12-13T22:59:05.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 140.130062ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
9912024-12-13T22:59:05.437ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 635.220631ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
9922024-12-13T22:59:05.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 270.805196ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
9932024-12-13T22:59:05.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 154.05588ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
9942024-12-13T22:59:05.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 112.546589ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
9952024-12-13T22:59:05.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 529.358708ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
9962024-12-13T22:59:05.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 162.75902ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
9972024-12-13T22:59:05.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 230.077693ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
9982024-12-13T22:59:05.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 134.432603ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
9992024-12-13T22:59:05.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 546.502669ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10002024-12-13T22:59:06.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 454.620406ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10012024-12-13T22:59:06.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 446.368231ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
10022024-12-13T22:59:06.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 1.036228772s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10032024-12-13T22:59:06.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 750.623374ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
10042024-12-13T22:59:06.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 994.730937ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10052024-12-13T22:59:06.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 544.230507ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10062024-12-13T22:59:06.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 570.851733ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
10072024-12-13T22:59:07.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 742.086473ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
10082024-12-13T22:59:07.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.000019616s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10092024-12-13T22:59:07.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 838.73259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
10102024-12-13T22:59:07.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 818.558532ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10112024-12-13T22:59:07.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 536.043758ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10122024-12-13T22:59:07.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 1.152102874s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
10132024-12-13T22:59:08.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 1.297981925s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
10142024-12-13T22:59:08.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 1.271600151s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10152024-12-13T22:59:08.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 1.292545605s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10162024-12-13T22:59:08.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.279164859s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10172024-12-13T22:59:09.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 744.854002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
10182024-12-13T22:59:09.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 1.486388776s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
10192024-12-13T22:59:09.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 628.888503ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10202024-12-13T22:59:09.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 1.021343399s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10212024-12-13T22:59:09.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 512.350518ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10222024-12-13T22:59:09.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 908.456117ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
10232024-12-13T22:59:09.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.103467505s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10242024-12-13T22:59:09.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 1.415605116s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10252024-12-13T22:59:10.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 632.000618ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10262024-12-13T22:59:10.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 1.275671383s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
10272024-12-13T22:59:10.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 749.699124ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
10282024-12-13T22:59:11.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 599.493891ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10292024-12-13T22:59:11.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.346671739s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10302024-12-13T22:59:11.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 749.957175ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10312024-12-13T22:59:11.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb") failed: Property not found. retry in 960.798448ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
10322024-12-13T22:59:11.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 603.089319ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10332024-12-13T22:59:11.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0") failed: Property not found. retry in 1.220261098s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
10342024-12-13T22:59:12.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1") failed: Property not found. retry in 1.244238651s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10352024-12-13T22:59:12.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e") failed: Property not found. retry in 1.188242481s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10362024-12-13T22:59:12.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 908.620258ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10372024-12-13T22:59:13.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.024736607s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10382024-12-13T22:59:14.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 938.676145ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10392024-12-13T22:59:15.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 848.759382ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10402024-12-13T22:59:16.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.233329706s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10412024-12-13T22:59:18.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 943.950415ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10422024-12-13T22:59:19.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.015918552s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10432024-12-13T22:59:20.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.408077497s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10442024-12-13T22:59:21.198ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.09018709s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
10452024-12-13T22:59:21.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 826.764963ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10462024-12-13T22:59:22.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 517.580421ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10472024-12-13T22:59:22.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f") failed: Property not found. retry in 1.439916591s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10482024-12-13T22:59:24.389ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_133f4f0a-5893-4080-8b87-7329d1571a5e
10492024-12-13T22:59:24.389ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_eafb0c5f-d0bb-400e-8ad3-b8972401d5eb
10502024-12-13T22:59:24.389ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_f30b25b2-d13e-43ec-89e0-6c5ea663c5c0
10512024-12-13T22:59:24.389ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_e862e238-b979-4849-90fc-5e881fb5b5c1
10522024-12-13T22:59:24.389ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f
10532024-12-13T22:59:24.389ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10542024-12-13T22:59:24.393ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10552024-12-13T22:59:24.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23788313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55579 req_id = f271801c-c4b2-4cb7-b8aa-c499b56488d4 response_code = 204 uri = /omicron-zones
10562024-12-13T22:59:24.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58006
10572024-12-13T22:59:24.501ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3743
10582024-12-13T22:59:26.081ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
10592024-12-13T22:59:26.911ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38419
10602024-12-13T22:59:26.911ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38419 req_id = 2ce60713-f160-4649-ba8f-c3ba02a44e1a response_code = 200 uri = /baseboard
10612024-12-13T22:59:36.983ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10622024-12-13T22:59:36.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12530500 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58006 req_id = ab16c65d-7758-4ce0-823b-fc53c6e65c3c response_code = 204 uri = /cockroachdb
10632024-12-13T22:59:37.017ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: b88c164b-e402-4ec9-9363-11d16ca7dbdf (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24 (service), filesystem_pool: Some(ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749 (service), filesystem_pool: Some(ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f (service), filesystem_pool: Some(ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eb37b437-c7d8-494a-8f33-40ad21b73e11, kind: Service { id: 0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f }, name: Name("ntp-0eb88268-3b24-4cc9-8f54-e5ec70ee9c7f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 59])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: eafb0c5f-d0bb-400e-8ad3-b8972401d5eb (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } } } }, OmicronZoneConfig { id: f30b25b2-d13e-43ec-89e0-6c5ea663c5c0 (service), filesystem_pool: Some(ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } } } }, OmicronZoneConfig { id: 133f4f0a-5893-4080-8b87-7329d1571a5e (service), filesystem_pool: Some(ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External } } } }, OmicronZoneConfig { id: a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f (service), filesystem_pool: Some(ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External } } } }, OmicronZoneConfig { id: e862e238-b979-4849-90fc-5e881fb5b5c1 (service), filesystem_pool: Some(ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External } } } }, OmicronZoneConfig { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 (service), filesystem_pool: Some(ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 (service), filesystem_pool: Some(ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 (service), filesystem_pool: Some(ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 (service), filesystem_pool: Some(ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 79f97b1c-5adc-4433-8fb3-694c98815b76 (service), filesystem_pool: Some(ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 2e5a072c-56d8-43b5-b043-0f7b102649d0 (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } } } }, OmicronZoneConfig { id: 8fb90a28-bdec-45a7-95c7-b65381216e92 (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: f5dd1daa-052c-4891-ac90-a51f60320942 (service), filesystem_pool: Some(ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 0609f269-d5d8-4901-a399-2298bf60524f (service), filesystem_pool: Some(ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 11077c37-531c-45bb-8afe-a287cca74695 (service), filesystem_pool: Some(ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External } } } }, OmicronZoneConfig { id: 9e14c1a1-8561-454f-a886-01216a157150 (service), filesystem_pool: Some(ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External } } } }, OmicronZoneConfig { id: 51090476-4cb4-4299-81dd-872e93ca7475 (service), filesystem_pool: Some(ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7 (service), filesystem_pool: Some(ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0e30334a-3d4a-4136-bcbb-dc5014d497a8 (service), filesystem_pool: Some(ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External } } } }, OmicronZoneConfig { id: a817d1e7-6c11-4e34-9b70-c17a5904aca0 (service), filesystem_pool: Some(ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External } } } }, OmicronZoneConfig { id: 59dbba2f-8e07-41f2-9c4c-cdb411b5f153 (service), filesystem_pool: Some(ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External } } } }, OmicronZoneConfig { id: f45a11e5-1389-48be-9ad5-cf9605c32a2e (service), filesystem_pool: Some(ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External } } } }, OmicronZoneConfig { id: 6cff243c-1194-49e7-b500-93b1843b510d (service), filesystem_pool: Some(ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10642024-12-13T22:59:37.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58121
10652024-12-13T22:59:37.017ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b88c164b-e402-4ec9-9363-11d16ca7dbdf, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
10662024-12-13T22:59:37.017ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: b88c164b-e402-4ec9-9363-11d16ca7dbdf, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10672024-12-13T22:59:37.085ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
10682024-12-13T22:59:37.085ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 20fde3a4-5e95-4e74-ba1d-0071f7323c24, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: InternalDns }, responder: ... }
10692024-12-13T22:59:37.141ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
10702024-12-13T22:59:37.141ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 1e33e0af-aaa2-488b-a8e8-43c2cb761749, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10712024-12-13T22:59:37.205ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eafb0c5f-d0bb-400e-8ad3-b8972401d5eb, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
10722024-12-13T22:59:37.205ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: eafb0c5f-d0bb-400e-8ad3-b8972401d5eb, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10732024-12-13T22:59:37.266ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f30b25b2-d13e-43ec-89e0-6c5ea663c5c0, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
10742024-12-13T22:59:37.266ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: f30b25b2-d13e-43ec-89e0-6c5ea663c5c0, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10752024-12-13T22:59:37.326ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 133f4f0a-5893-4080-8b87-7329d1571a5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
10762024-12-13T22:59:37.326ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 133f4f0a-5893-4080-8b87-7329d1571a5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10772024-12-13T22:59:37.332ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.538505746s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
10782024-12-13T22:59:37.391ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f, dataset_name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
10792024-12-13T22:59:37.391ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: a70ea3ed-8cb3-4d39-b7c1-a375e0521e3f, dataset_name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10802024-12-13T22:59:37.460ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e862e238-b979-4849-90fc-5e881fb5b5c1, dataset_name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:606
10812024-12-13T22:59:37.460ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: e862e238-b979-4849-90fc-5e881fb5b5c1, dataset_name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10822024-12-13T22:59:37.527ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 04a3334b-9752-441b-939b-8e2c1e79fc9b, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
10832024-12-13T22:59:37.527ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 04a3334b-9752-441b-939b-8e2c1e79fc9b, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10842024-12-13T22:59:37.595ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4c5c2ead-0193-4378-96e2-af2730e9ff43, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:606
10852024-12-13T22:59:37.595ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 4c5c2ead-0193-4378-96e2-af2730e9ff43, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10862024-12-13T22:59:37.657ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2e5a072c-56d8-43b5-b043-0f7b102649d0, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:606
10872024-12-13T22:59:37.657ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 2e5a072c-56d8-43b5-b043-0f7b102649d0, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10882024-12-13T22:59:37.721ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 11077c37-531c-45bb-8afe-a287cca74695, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
10892024-12-13T22:59:37.721ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 11077c37-531c-45bb-8afe-a287cca74695, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, kind: Crucible }, responder: ... }
10902024-12-13T22:59:37.792ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9e14c1a1-8561-454f-a886-01216a157150, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
10912024-12-13T22:59:37.792ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 9e14c1a1-8561-454f-a886-01216a157150, dataset_name: DatasetName { pool_name: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, kind: Crucible }, responder: ... }
10922024-12-13T22:59:37.859ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 51090476-4cb4-4299-81dd-872e93ca7475, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
10932024-12-13T22:59:37.859ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 51090476-4cb4-4299-81dd-872e93ca7475, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, kind: Crucible }, responder: ... }
10942024-12-13T22:59:37.923ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7, dataset_name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
10952024-12-13T22:59:37.923ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7, dataset_name: DatasetName { pool_name: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, kind: Crucible }, responder: ... }
10962024-12-13T22:59:37.993ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e30334a-3d4a-4136-bcbb-dc5014d497a8, dataset_name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
10972024-12-13T22:59:37.993ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 0e30334a-3d4a-4136-bcbb-dc5014d497a8, dataset_name: DatasetName { pool_name: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, kind: Crucible }, responder: ... }
10982024-12-13T22:59:38.063ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a817d1e7-6c11-4e34-9b70-c17a5904aca0, dataset_name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
10992024-12-13T22:59:38.063ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: a817d1e7-6c11-4e34-9b70-c17a5904aca0, dataset_name: DatasetName { pool_name: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, kind: Crucible }, responder: ... }
11002024-12-13T22:59:38.124ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 59dbba2f-8e07-41f2-9c4c-cdb411b5f153, dataset_name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
11012024-12-13T22:59:38.124ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 59dbba2f-8e07-41f2-9c4c-cdb411b5f153, dataset_name: DatasetName { pool_name: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, kind: Crucible }, responder: ... }
11022024-12-13T22:59:38.184ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f45a11e5-1389-48be-9ad5-cf9605c32a2e, dataset_name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
11032024-12-13T22:59:38.184ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: f45a11e5-1389-48be-9ad5-cf9605c32a2e, dataset_name: DatasetName { pool_name: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, kind: Crucible }, responder: ... }
11042024-12-13T22:59:38.250ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6cff243c-1194-49e7-b500-93b1843b510d, dataset_name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:606
11052024-12-13T22:59:38.250ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 6cff243c-1194-49e7-b500-93b1843b510d, dataset_name: DatasetName { pool_name: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, kind: Crucible }, responder: ... }
11062024-12-13T22:59:38.312ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11072024-12-13T22:59:38.312ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:177
11082024-12-13T22:59:38.312ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:177
11092024-12-13T22:59:38.312ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11102024-12-13T22:59:38.443ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11112024-12-13T22:59:38.443ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11122024-12-13T22:59:38.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11132024-12-13T22:59:38.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11142024-12-13T22:59:38.445ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11152024-12-13T22:59:38.446ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11162024-12-13T22:59:38.497ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11172024-12-13T22:59:38.498ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11182024-12-13T22:59:38.498ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11192024-12-13T22:59:38.498ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11202024-12-13T22:59:38.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11212024-12-13T22:59:38.700ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11222024-12-13T22:59:38.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11232024-12-13T22:59:38.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11242024-12-13T22:59:38.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11252024-12-13T22:59:38.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11262024-12-13T22:59:38.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11272024-12-13T22:59:38.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11282024-12-13T22:59:38.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11292024-12-13T22:59:38.727ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8 file = illumos-utils/src/zone.rs:325
11302024-12-13T22:59:38.732ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0 file = illumos-utils/src/zone.rs:325
11312024-12-13T22:59:38.737ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942 file = illumos-utils/src/zone.rs:325
11322024-12-13T22:59:38.742ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0 file = illumos-utils/src/zone.rs:325
11332024-12-13T22:59:38.747ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695 file = illumos-utils/src/zone.rs:325
11342024-12-13T22:59:38.752ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150 file = illumos-utils/src/zone.rs:325
11352024-12-13T22:59:38.758ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153 file = illumos-utils/src/zone.rs:325
11362024-12-13T22:59:38.898ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8 file = illumos-utils/src/zone.rs:363
11372024-12-13T22:59:38.904ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0 file = illumos-utils/src/zone.rs:363
11382024-12-13T22:59:38.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942 file = illumos-utils/src/zone.rs:363
11392024-12-13T22:59:38.914ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0 file = illumos-utils/src/zone.rs:363
11402024-12-13T22:59:38.918ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695 file = illumos-utils/src/zone.rs:363
11412024-12-13T22:59:38.923ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150 file = illumos-utils/src/zone.rs:363
11422024-12-13T22:59:38.927ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153 file = illumos-utils/src/zone.rs:363
11432024-12-13T22:59:38.933ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e file = illumos-utils/src/zone.rs:325
11442024-12-13T22:59:38.938ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d file = illumos-utils/src/zone.rs:325
11452024-12-13T22:59:38.943ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f file = illumos-utils/src/zone.rs:325
11462024-12-13T22:59:38.948ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92 file = illumos-utils/src/zone.rs:325
11472024-12-13T22:59:38.953ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76 file = illumos-utils/src/zone.rs:325
11482024-12-13T22:59:38.959ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7 file = illumos-utils/src/zone.rs:325
11492024-12-13T22:59:38.965ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475 file = illumos-utils/src/zone.rs:325
11502024-12-13T22:59:38.974ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e file = illumos-utils/src/zone.rs:363
11512024-12-13T22:59:38.982ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d file = illumos-utils/src/zone.rs:363
11522024-12-13T22:59:38.990ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f file = illumos-utils/src/zone.rs:363
11532024-12-13T22:59:38.998ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92 file = illumos-utils/src/zone.rs:363
11542024-12-13T22:59:39.007ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76 file = illumos-utils/src/zone.rs:363
11552024-12-13T22:59:39.020ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7 file = illumos-utils/src/zone.rs:363
11562024-12-13T22:59:39.042ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475 file = illumos-utils/src/zone.rs:363
11572024-12-13T22:59:39.238ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11582024-12-13T22:59:39.296ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11592024-12-13T22:59:39.354ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11602024-12-13T22:59:39.411ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11612024-12-13T22:59:39.513ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11622024-12-13T22:59:39.515ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11632024-12-13T22:59:39.515ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11642024-12-13T22:59:39.582ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 254, 60]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11652024-12-13T22:59:39.582ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11662024-12-13T22:59:39.583ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11672024-12-13T22:59:39.583ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11682024-12-13T22:59:39.673ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 180, 86]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11692024-12-13T22:59:39.673ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11702024-12-13T22:59:39.675ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11712024-12-13T22:59:39.675ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11722024-12-13T22:59:39.736ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 179, 85]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11732024-12-13T22:59:39.736ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11742024-12-13T22:59:39.738ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11752024-12-13T22:59:39.738ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11762024-12-13T22:59:39.795ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 208, 215]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11772024-12-13T22:59:39.795ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11782024-12-13T22:59:39.797ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11792024-12-13T22:59:39.797ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11802024-12-13T22:59:39.853ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 154, 203]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11812024-12-13T22:59:39.853ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11822024-12-13T22:59:39.858ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11832024-12-13T22:59:39.858ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11842024-12-13T22:59:39.860ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11852024-12-13T22:59:39.860ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11862024-12-13T22:59:39.860ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11872024-12-13T22:59:39.860ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11882024-12-13T22:59:39.860ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11892024-12-13T22:59:39.860ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11902024-12-13T22:59:39.860ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11912024-12-13T22:59:39.860ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11922024-12-13T22:59:39.863ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11932024-12-13T22:59:39.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11942024-12-13T22:59:39.901ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11952024-12-13T22:59:39.905ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11962024-12-13T22:59:39.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11972024-12-13T22:59:39.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
11982024-12-13T22:59:39.911ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11992024-12-13T22:59:39.914ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12002024-12-13T22:59:39.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
12012024-12-13T22:59:39.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
12022024-12-13T22:59:39.917ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662 file = illumos-utils/src/zone.rs:325
12032024-12-13T22:59:40.045ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662 file = illumos-utils/src/zone.rs:363
12042024-12-13T22:59:40.053ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 file = illumos-utils/src/zone.rs:325
12052024-12-13T22:59:40.060ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 file = illumos-utils/src/zone.rs:325
12062024-12-13T22:59:40.066ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b file = illumos-utils/src/zone.rs:325
12072024-12-13T22:59:40.073ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43 file = illumos-utils/src/zone.rs:325
12082024-12-13T22:59:40.082ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 file = illumos-utils/src/zone.rs:363
12092024-12-13T22:59:40.090ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 file = illumos-utils/src/zone.rs:363
12102024-12-13T22:59:40.098ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b file = illumos-utils/src/zone.rs:363
12112024-12-13T22:59:40.104ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43 file = illumos-utils/src/zone.rs:363
12122024-12-13T22:59:48.068ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12132024-12-13T22:59:48.522ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
12142024-12-13T22:59:48.710ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7e4f9e60-5a10-4a0b-b9c0-7df2ca461fe2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12152024-12-13T22:59:48.712ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_46df782d-5e10-4410-8b6c-9b413351c0ef/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e8e73a7a-311b-4ada-9582-2c07551ea962'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12162024-12-13T22:59:49.032ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fd16b77c-9fd8-45f8-94cb-0d502a3326db'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12172024-12-13T22:59:49.032ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d294a39b-ca1d-4b38-9f66-2f0278181d0f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12182024-12-13T22:59:49.033ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_66612a50-feea-47ce-a70f-e7d816b9348f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5d384c3e-b15c-4c43-a151-71a809f3c9da'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12192024-12-13T22:59:49.034ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='43f94e34-7d64-43ee-aa05-b9f89f157620'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12202024-12-13T22:59:49.206ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12212024-12-13T22:59:49.206ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_27177673-3a08-4285-914d-2d0755afcc21/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='796bdae4-4bf8-405c-8c5b-f57e4a8df75c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12222024-12-13T22:59:49.206ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7ecf842b-e498-4351-b151-8dff95453908/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0f225589-c002-4da4-b1bf-7f830f15ecb3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12232024-12-13T22:59:49.206ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
12242024-12-13T22:59:49.317ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
12252024-12-13T22:59:49.322ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
12262024-12-13T22:59:49.328ZINFOSledAgent (ServiceManager): Booting oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
12272024-12-13T22:59:49.334ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
12282024-12-13T22:59:49.340ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
12292024-12-13T22:59:49.346ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
12302024-12-13T22:59:49.352ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
12312024-12-13T22:59:49.358ZINFOSledAgent (ServiceManager): Booting oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
12322024-12-13T22:59:49.434ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12332024-12-13T22:59:49.435ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
12342024-12-13T22:59:49.718ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='79f97b1c-5adc-4433-8fb3-694c98815b76'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352024-12-13T22:59:49.718ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
12362024-12-13T22:59:49.889ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f7cfdce7-5264-4421-96d5-85418ddb748d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='319cdd77-19db-4a90-8190-27cdef1ac45e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372024-12-13T22:59:50.026ZINFOSledAgent (ServiceManager): Booting oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
12382024-12-13T22:59:50.525ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12392024-12-13T22:59:50.525ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
12402024-12-13T22:59:51.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 62.252912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
12412024-12-13T22:59:51.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 39.204976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
12422024-12-13T22:59:51.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 46.443467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
12432024-12-13T22:59:51.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 33.217823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
12442024-12-13T22:59:51.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 43.921501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
12452024-12-13T22:59:51.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 53.422259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
12462024-12-13T22:59:51.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 47.943707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
12472024-12-13T22:59:51.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 68.934879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
12482024-12-13T22:59:51.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 58.008884ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
12492024-12-13T22:59:51.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 70.223474ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
12502024-12-13T22:59:51.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 61.607098ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
12512024-12-13T22:59:51.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 34.843463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
12522024-12-13T22:59:51.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 75.637016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
12532024-12-13T22:59:51.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 141.292014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
12542024-12-13T22:59:51.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 90.321885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
12552024-12-13T22:59:51.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 124.11652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
12562024-12-13T22:59:51.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 86.048797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
12572024-12-13T22:59:51.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 143.330839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
12582024-12-13T22:59:51.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 50.889371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
12592024-12-13T22:59:51.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 145.070653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
12602024-12-13T22:59:51.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 132.364997ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
12612024-12-13T22:59:51.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 57.877832ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
12622024-12-13T22:59:51.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 108.139781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
12632024-12-13T22:59:51.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 139.03988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
12642024-12-13T22:59:51.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 131.061228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
12652024-12-13T22:59:51.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 260.771207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
12662024-12-13T22:59:51.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 260.523625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
12672024-12-13T22:59:51.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 264.460594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
12682024-12-13T22:59:51.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 215.199528ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
12692024-12-13T22:59:51.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 256.189473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
12702024-12-13T22:59:51.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 289.688733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
12712024-12-13T22:59:51.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 291.725763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
12722024-12-13T22:59:51.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 174.579852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
12732024-12-13T22:59:51.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 197.809127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
12742024-12-13T22:59:51.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 190.28987ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
12752024-12-13T22:59:51.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 137.77903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
12762024-12-13T22:59:51.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 259.075666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
12772024-12-13T22:59:51.955ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12782024-12-13T22:59:51.955ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
12792024-12-13T22:59:52.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 592.33098ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
12802024-12-13T22:59:52.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 400.851787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
12812024-12-13T22:59:52.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 472.83508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
12822024-12-13T22:59:52.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 387.453624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
12832024-12-13T22:59:52.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 379.48141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
12842024-12-13T22:59:52.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 331.706687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
12852024-12-13T22:59:52.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 315.660282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
12862024-12-13T22:59:52.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 209.998435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
12872024-12-13T22:59:52.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 456.407564ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
12882024-12-13T22:59:52.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 233.371653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
12892024-12-13T22:59:52.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 65.445678ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
12902024-12-13T22:59:52.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 545.902328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
12912024-12-13T22:59:52.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 896.270185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
12922024-12-13T22:59:52.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 111.874262ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
12932024-12-13T22:59:52.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 895.734964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
12942024-12-13T22:59:52.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 251.462228ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
12952024-12-13T22:59:52.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.120370248s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
12962024-12-13T22:59:52.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 969.53808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
12972024-12-13T22:59:52.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 434.963266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
12982024-12-13T22:59:52.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 414.214423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
12992024-12-13T22:59:52.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.142448739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
13002024-12-13T22:59:52.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 746.068162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
13012024-12-13T22:59:52.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 889.127477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
13022024-12-13T22:59:52.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 535.525884ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
13032024-12-13T22:59:52.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 253.294059ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
13042024-12-13T22:59:52.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 472.607864ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
13052024-12-13T22:59:52.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.175388632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
13062024-12-13T22:59:52.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 651.994507ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
13072024-12-13T22:59:52.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.112421124s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
13082024-12-13T22:59:52.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.285914682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
13092024-12-13T22:59:53.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.335311715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
13102024-12-13T22:59:53.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 765.330841ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
13112024-12-13T22:59:53.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 795.163841ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
13122024-12-13T22:59:53.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.31966673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
13132024-12-13T22:59:53.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 866.836603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
13142024-12-13T22:59:53.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.309556439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
13152024-12-13T22:59:53.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 1.391065315s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
13162024-12-13T22:59:53.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.422201707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
13172024-12-13T22:59:53.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 30.030522ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13182024-12-13T22:59:53.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 583.487647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
13192024-12-13T22:59:54.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 588.502804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
13202024-12-13T22:59:54.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.154480356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
13212024-12-13T22:59:54.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 525.109497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
13222024-12-13T22:59:54.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 41.528509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13232024-12-13T22:59:54.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 70.367154ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13242024-12-13T22:59:54.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 107.05136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13252024-12-13T22:59:54.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 167.472158ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13262024-12-13T22:59:54.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 939.689291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
13272024-12-13T22:59:54.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 296.782027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13282024-12-13T22:59:54.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 588.78578ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13292024-12-13T22:59:54.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 834.492693ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
13302024-12-13T22:59:54.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.237350725s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
13312024-12-13T22:59:54.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 676.355909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
13322024-12-13T22:59:54.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.195643916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
13332024-12-13T22:59:54.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 226.934778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13342024-12-13T22:59:54.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 688.109504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
13352024-12-13T22:59:54.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.079992288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
13362024-12-13T22:59:54.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 725.433105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
13372024-12-13T22:59:54.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 996.721896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13382024-12-13T22:59:54.962ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.233197356s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
13392024-12-13T22:59:54.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 614.888165ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13402024-12-13T22:59:55.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 828.875253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
13412024-12-13T22:59:55.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.316375961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
13422024-12-13T22:59:55.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.073450424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
13432024-12-13T22:59:55.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 597.306206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
13442024-12-13T22:59:55.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.276095219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
13452024-12-13T22:59:55.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 659.554696ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
13462024-12-13T22:59:55.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.49973002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
13472024-12-13T22:59:55.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.477369401s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
13482024-12-13T22:59:55.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 555.432108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
13492024-12-13T22:59:55.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 890.279646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
13502024-12-13T22:59:55.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.476461788s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13512024-12-13T22:59:55.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 802.324427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
13522024-12-13T22:59:55.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.009236051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
13532024-12-13T22:59:55.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.014881333s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
13542024-12-13T22:59:55.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.079159729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
13552024-12-13T22:59:55.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.042826876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13562024-12-13T22:59:55.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.497277979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
13572024-12-13T22:59:55.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 1.14540318s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
13582024-12-13T22:59:55.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.178572772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
13592024-12-13T22:59:56.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.365054114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
13602024-12-13T22:59:56.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 803.998031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
13612024-12-13T22:59:56.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 671.982657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
13622024-12-13T22:59:56.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.418818294s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
13632024-12-13T22:59:56.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.14216057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
13642024-12-13T22:59:56.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 766.605134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
13652024-12-13T22:59:56.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 870.838323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
13662024-12-13T22:59:56.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.298417401s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
13672024-12-13T22:59:56.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.466421521s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
13682024-12-13T22:59:56.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.105198891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13692024-12-13T22:59:56.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.17303617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
13702024-12-13T22:59:56.955ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60084
13712024-12-13T22:59:56.957ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 967 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60084 req_id = 7ed7df7f-b4fe-4b17-8494-ca807694cbac response_code = 200 uri = /baseboard
13722024-12-13T22:59:57.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 806.473755ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13732024-12-13T22:59:57.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 770.158861ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
13742024-12-13T22:59:57.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.295370086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
13752024-12-13T22:59:57.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 986.629159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
13762024-12-13T22:59:57.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 606.383661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
13772024-12-13T22:59:57.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.00261833s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
13782024-12-13T22:59:57.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.238795409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
13792024-12-13T22:59:57.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.225248518s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
13802024-12-13T22:59:57.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.303767261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
13812024-12-13T22:59:57.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.314612081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
13822024-12-13T22:59:57.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.186620978s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
13832024-12-13T22:59:57.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 874.584748ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13842024-12-13T22:59:57.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 1.475208346s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
13852024-12-13T22:59:57.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.392446349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
13862024-12-13T22:59:58.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 836.678835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13872024-12-13T22:59:58.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 903.788574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
13882024-12-13T22:59:58.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.251922513s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
13892024-12-13T22:59:58.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 738.685442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
13902024-12-13T22:59:58.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.495966638s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
13912024-12-13T22:59:58.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.452415665s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
13922024-12-13T22:59:58.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.056376385s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
13932024-12-13T22:59:58.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.133446691s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
13942024-12-13T22:59:58.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.391265055s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
13952024-12-13T22:59:58.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 996.36168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
13962024-12-13T22:59:58.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 515.838615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
13972024-12-13T22:59:58.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 903.634684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
13982024-12-13T22:59:59.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 816.889345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
13992024-12-13T22:59:59.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.048471895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
14002024-12-13T22:59:59.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 876.119183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
14012024-12-13T22:59:59.046ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14022024-12-13T22:59:59.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 790.924472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
14032024-12-13T22:59:59.062ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14042024-12-13T22:59:59.259ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14052024-12-13T22:59:59.259ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14062024-12-13T22:59:59.266ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14072024-12-13T22:59:59.266ZINFOSledAgent (ServiceManager): Booting oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14082024-12-13T22:59:59.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 26.242132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14092024-12-13T22:59:59.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 96.057218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14102024-12-13T22:59:59.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.468808381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
14112024-12-13T22:59:59.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 992.407602ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
14122024-12-13T22:59:59.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.005354965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
14132024-12-13T22:59:59.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 872.715033ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
14142024-12-13T22:59:59.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 156.490637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14152024-12-13T22:59:59.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 59.92104ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14162024-12-13T22:59:59.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 53.929686ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14172024-12-13T22:59:59.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.074841851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
14182024-12-13T22:59:59.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 127.501201ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14192024-12-13T22:59:59.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 112.174287ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14202024-12-13T22:59:59.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 561.635397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14212024-12-13T22:59:59.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 206.019877ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14222024-12-13T22:59:59.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 130.746873ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14232024-12-13T22:59:59.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 654.443745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
14242024-12-13T22:59:59.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.21412329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
14252024-12-13T22:59:59.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.441510768s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
14262024-12-13T22:59:59.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.353379424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
14272024-12-13T22:59:59.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 465.772423ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14282024-12-13T22:59:59.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 541.803155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
14292024-12-13T22:59:59.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 986.09042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
14302024-12-13T22:59:59.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.353357852s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
14312024-12-13T22:59:59.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 493.509681ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14322024-12-13T22:59:59.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 547.639601ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
14332024-12-13T23:00:00.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 804.083247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
14342024-12-13T23:00:00.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 539.199963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14352024-12-13T23:00:00.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.310364771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
14362024-12-13T23:00:00.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.466547063s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
14372024-12-13T23:00:00.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.007179841s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14382024-12-13T23:00:00.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 1.379884299s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
14392024-12-13T23:00:00.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.02230598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
14402024-12-13T23:00:00.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.369703588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
14412024-12-13T23:00:00.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 410.359845ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14422024-12-13T23:00:00.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 515.944046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
14432024-12-13T23:00:00.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.415768448s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
14442024-12-13T23:00:00.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.361266024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
14452024-12-13T23:00:00.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 1.11480944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14462024-12-13T23:00:00.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.214996546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
14472024-12-13T23:00:00.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 1.292111189s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14482024-12-13T23:00:00.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 656.048943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
14492024-12-13T23:00:00.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.242866041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
14502024-12-13T23:00:01.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.306598646s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
14512024-12-13T23:00:01.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.364070942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
14522024-12-13T23:00:01.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.066750229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
14532024-12-13T23:00:01.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 598.534188ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
14542024-12-13T23:00:01.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.447053052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
14552024-12-13T23:00:01.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 672.029784ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14562024-12-13T23:00:01.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.004094043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
14572024-12-13T23:00:01.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 889.037986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
14582024-12-13T23:00:01.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.21426069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
14592024-12-13T23:00:01.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 626.732953ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
14602024-12-13T23:00:01.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 712.166311ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
14612024-12-13T23:00:01.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.342209905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
14622024-12-13T23:00:01.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 841.182441ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14632024-12-13T23:00:01.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.29124686s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
14642024-12-13T23:00:01.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.246455225s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
14652024-12-13T23:00:02.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.16420555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
14662024-12-13T23:00:02.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 619.625227ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14672024-12-13T23:00:02.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 506.076307ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
14682024-12-13T23:00:02.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.027756183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
14692024-12-13T23:00:02.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 506.241622ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14702024-12-13T23:00:02.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.195507065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
14712024-12-13T23:00:02.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.022162313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
14722024-12-13T23:00:02.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.399320759s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
14732024-12-13T23:00:02.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.139700538s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
14742024-12-13T23:00:02.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 515.510279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
14752024-12-13T23:00:02.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.106771194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
14762024-12-13T23:00:02.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 640.866755ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
14772024-12-13T23:00:02.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 622.216753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
14782024-12-13T23:00:02.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.056940654s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
14792024-12-13T23:00:02.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 864.096978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
14802024-12-13T23:00:02.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 935.656676ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
14812024-12-13T23:00:02.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 680.748619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
14822024-12-13T23:00:02.816ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14832024-12-13T23:00:02.816ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
14842024-12-13T23:00:02.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.039182117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
14852024-12-13T23:00:03.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.126152863s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
14862024-12-13T23:00:03.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 49.690734ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
14872024-12-13T23:00:03.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 833.316394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
14882024-12-13T23:00:03.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.001469208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
14892024-12-13T23:00:03.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 1.237020029s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
14902024-12-13T23:00:03.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 66.006966ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
14912024-12-13T23:00:03.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.399500407s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
14922024-12-13T23:00:03.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.099486938s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
14932024-12-13T23:00:03.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 607.530458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
14942024-12-13T23:00:03.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 995.480691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
14952024-12-13T23:00:03.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 110.994616ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
14962024-12-13T23:00:03.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 678.051909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
14972024-12-13T23:00:03.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 593.228384ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
14982024-12-13T23:00:03.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.119158775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
14992024-12-13T23:00:03.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 591.17117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
15002024-12-13T23:00:03.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.39605794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
15012024-12-13T23:00:03.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 1.237415642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
15022024-12-13T23:00:03.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.367205841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
15032024-12-13T23:00:03.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 1.417813209s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
15042024-12-13T23:00:03.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.121112239s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
15052024-12-13T23:00:03.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 510.163859ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
15062024-12-13T23:00:03.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.371537067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
15072024-12-13T23:00:03.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.079954761s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
15082024-12-13T23:00:04.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.233359164s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
15092024-12-13T23:00:04.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 1.014888996s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
15102024-12-13T23:00:04.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.165046888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
15112024-12-13T23:00:04.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.038435221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
15122024-12-13T23:00:04.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.150670483s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
15132024-12-13T23:00:04.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 741.983436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
15142024-12-13T23:00:04.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 634.742614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
15152024-12-13T23:00:04.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 741.54836ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
15162024-12-13T23:00:04.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.316064096s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
15172024-12-13T23:00:04.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 753.514414ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
15182024-12-13T23:00:04.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.038205686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
15192024-12-13T23:00:04.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.45878619s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
15202024-12-13T23:00:04.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 1.427718977s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
15212024-12-13T23:00:04.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 550.615459ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
15222024-12-13T23:00:04.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.030289887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
15232024-12-13T23:00:04.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 950.570198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
15242024-12-13T23:00:04.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 565.230718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
15252024-12-13T23:00:05.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.058983075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
15262024-12-13T23:00:05.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 511.558107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
15272024-12-13T23:00:05.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 745.51973ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
15282024-12-13T23:00:05.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 976.085186ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
15292024-12-13T23:00:05.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 1.210861678s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
15302024-12-13T23:00:05.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.35741967s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
15312024-12-13T23:00:05.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 747.523309ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
15322024-12-13T23:00:05.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.21551898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
15332024-12-13T23:00:05.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 686.715317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
15342024-12-13T23:00:05.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.057516167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
15352024-12-13T23:00:05.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.126207301s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
15362024-12-13T23:00:05.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.203820306s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
15372024-12-13T23:00:05.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.479797666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
15382024-12-13T23:00:05.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 925.388988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
15392024-12-13T23:00:05.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.109007099s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
15402024-12-13T23:00:05.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 910.381131ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
15412024-12-13T23:00:05.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 1.066529303s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
15422024-12-13T23:00:05.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 613.418841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
15432024-12-13T23:00:05.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 578.047064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
15442024-12-13T23:00:05.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.019492332s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
15452024-12-13T23:00:05.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 597.008516ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
15462024-12-13T23:00:06.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.025203434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
15472024-12-13T23:00:06.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.331325684s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
15482024-12-13T23:00:06.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.401011166s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
15492024-12-13T23:00:06.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 1.273792818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
15502024-12-13T23:00:06.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 968.852796ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
15512024-12-13T23:00:06.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.462135147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
15522024-12-13T23:00:06.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 814.56352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
15532024-12-13T23:00:06.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 633.377988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
15542024-12-13T23:00:06.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.086982032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
15552024-12-13T23:00:06.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.41036234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
15562024-12-13T23:00:06.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.235407198s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
15572024-12-13T23:00:06.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 518.365316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
15582024-12-13T23:00:06.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 707.81107ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
15592024-12-13T23:00:06.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.190265103s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
15602024-12-13T23:00:06.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 918.661596ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
15612024-12-13T23:00:06.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.274911448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
15622024-12-13T23:00:06.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 1.007438933s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
15632024-12-13T23:00:07.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.281295384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
15642024-12-13T23:00:07.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 704.830631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
15652024-12-13T23:00:07.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 920.964624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
15662024-12-13T23:00:07.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.323933935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
15672024-12-13T23:00:07.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.247522724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
15682024-12-13T23:00:07.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.423285065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
15692024-12-13T23:00:07.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 1.138587941s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
15702024-12-13T23:00:07.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 1.359647592s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
15712024-12-13T23:00:07.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.183231583s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
15722024-12-13T23:00:07.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.246617919s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
15732024-12-13T23:00:07.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 726.175572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
15742024-12-13T23:00:07.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 955.57403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
15752024-12-13T23:00:07.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 660.598214ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
15762024-12-13T23:00:07.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 883.239954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
15772024-12-13T23:00:07.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.013532079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
15782024-12-13T23:00:07.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.270515401s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
15792024-12-13T23:00:07.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.035597043s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
15802024-12-13T23:00:07.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 879.938205ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
15812024-12-13T23:00:07.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 645.242011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
15822024-12-13T23:00:08.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.125848253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
15832024-12-13T23:00:08.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 921.986242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
15842024-12-13T23:00:08.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.049142154s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
15852024-12-13T23:00:08.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 539.41148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
15862024-12-13T23:00:08.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.304123814s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
15872024-12-13T23:00:08.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 580.737142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
15882024-12-13T23:00:08.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 894.944235ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
15892024-12-13T23:00:08.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 546.785229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
15902024-12-13T23:00:08.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 1.335672238s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
15912024-12-13T23:00:08.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 625.303526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
15922024-12-13T23:00:08.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 803.371624ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
15932024-12-13T23:00:08.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.478470933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
15942024-12-13T23:00:08.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 977.595479ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
15952024-12-13T23:00:08.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.459412866s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
15962024-12-13T23:00:08.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 661.461472ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
15972024-12-13T23:00:08.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 1.185215973s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
15982024-12-13T23:00:08.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.454385156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
15992024-12-13T23:00:08.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.333965615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
16002024-12-13T23:00:08.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 972.714322ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
16012024-12-13T23:00:08.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 923.875775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
16022024-12-13T23:00:09.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.013445575s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
16032024-12-13T23:00:09.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 712.681259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
16042024-12-13T23:00:09.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 507.114468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
16052024-12-13T23:00:09.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 855.441983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
16062024-12-13T23:00:09.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.49822048s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
16072024-12-13T23:00:09.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.127097207s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
16082024-12-13T23:00:09.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 1.163467305s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
16092024-12-13T23:00:09.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.350292938s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
16102024-12-13T23:00:09.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 628.718347ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
16112024-12-13T23:00:09.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.476837682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
16122024-12-13T23:00:09.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.189322264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
16132024-12-13T23:00:09.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 979.555084ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
16142024-12-13T23:00:09.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.094447111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
16152024-12-13T23:00:09.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.211038467s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
16162024-12-13T23:00:09.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 776.487238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
16172024-12-13T23:00:09.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 1.185090717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
16182024-12-13T23:00:10.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 819.104989ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
16192024-12-13T23:00:10.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 731.723922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
16202024-12-13T23:00:10.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 970.991537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
16212024-12-13T23:00:10.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.322251364s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
16222024-12-13T23:00:10.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 925.342442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
16232024-12-13T23:00:10.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.455659994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
16242024-12-13T23:00:10.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 697.309104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
16252024-12-13T23:00:10.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.168931169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
16262024-12-13T23:00:10.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.443632976s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
16272024-12-13T23:00:10.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 1.394593882s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
16282024-12-13T23:00:10.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 938.584033ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
16292024-12-13T23:00:10.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 788.658175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
16302024-12-13T23:00:10.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 930.904975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
16312024-12-13T23:00:10.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.308364776s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
16322024-12-13T23:00:10.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 689.057576ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
16332024-12-13T23:00:10.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 847.811179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
16342024-12-13T23:00:10.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 1.231796446s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
16352024-12-13T23:00:10.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 982.214837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
16362024-12-13T23:00:10.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.350939155s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
16372024-12-13T23:00:11.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 993.360757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
16382024-12-13T23:00:11.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 784.937451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
16392024-12-13T23:00:11.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.419531342s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
16402024-12-13T23:00:11.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.494599866s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
16412024-12-13T23:00:11.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 648.95645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
16422024-12-13T23:00:11.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.06901663s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
16432024-12-13T23:00:11.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 861.478455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
16442024-12-13T23:00:11.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 1.382494805s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
16452024-12-13T23:00:11.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 798.552999ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
16462024-12-13T23:00:11.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 1.188781858s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
16472024-12-13T23:00:11.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.34751994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
16482024-12-13T23:00:11.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.049681169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
16492024-12-13T23:00:11.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 644.694798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
16502024-12-13T23:00:11.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7") failed: Property not found. retry in 790.705004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
16512024-12-13T23:00:11.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 825.2585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
16522024-12-13T23:00:11.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 1.338964476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
16532024-12-13T23:00:11.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 768.626641ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
16542024-12-13T23:00:11.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.352417256s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
16552024-12-13T23:00:12.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.161352995s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
16562024-12-13T23:00:12.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 625.703434ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
16572024-12-13T23:00:12.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 941.742975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
16582024-12-13T23:00:12.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 1.441789357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
16592024-12-13T23:00:12.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 760.63956ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
16602024-12-13T23:00:12.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.233283994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
16612024-12-13T23:00:12.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 657.695847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
16622024-12-13T23:00:12.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.047355431s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
16632024-12-13T23:00:12.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 1.026126333s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
16642024-12-13T23:00:12.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 589.397931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
16652024-12-13T23:00:12.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 624.655461ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
16662024-12-13T23:00:12.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 1.354555209s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
16672024-12-13T23:00:12.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 977.671197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
16682024-12-13T23:00:12.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.169986922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
16692024-12-13T23:00:12.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 699.648508ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
16702024-12-13T23:00:12.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 1.099843286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
16712024-12-13T23:00:13.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.276726095s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
16722024-12-13T23:00:13.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.161254523s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
16732024-12-13T23:00:13.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 689.330431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
16742024-12-13T23:00:13.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.368782069s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
16752024-12-13T23:00:13.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.234004215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
16762024-12-13T23:00:13.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 988.97235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
16772024-12-13T23:00:13.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 646.094344ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
16782024-12-13T23:00:13.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 1.342079166s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
16792024-12-13T23:00:13.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 945.833626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
16802024-12-13T23:00:13.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 697.825157ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
16812024-12-13T23:00:13.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 749.574424ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
16822024-12-13T23:00:13.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 857.884308ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
16832024-12-13T23:00:13.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 1.312855726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
16842024-12-13T23:00:13.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 648.267162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
16852024-12-13T23:00:13.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.100889403s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
16862024-12-13T23:00:13.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 1.029357859s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
16872024-12-13T23:00:13.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 840.184813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
16882024-12-13T23:00:13.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.022573013s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
16892024-12-13T23:00:14.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 788.063704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
16902024-12-13T23:00:14.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 1.355288011s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
16912024-12-13T23:00:14.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 901.464525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
16922024-12-13T23:00:14.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 814.774055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
16932024-12-13T23:00:14.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 880.026015ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
16942024-12-13T23:00:14.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475") failed: Property not found. retry in 1.316637771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
16952024-12-13T23:00:14.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 595.345023ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
16962024-12-13T23:00:14.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 881.116754ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
16972024-12-13T23:00:14.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 643.616241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
16982024-12-13T23:00:14.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8") failed: Property not found. retry in 1.446406065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
16992024-12-13T23:00:14.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 699.398007ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
17002024-12-13T23:00:14.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b") failed: Property not found. retry in 1.034622346s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
17012024-12-13T23:00:14.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942") failed: Property not found. retry in 916.544047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
17022024-12-13T23:00:14.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f") failed: Property not found. retry in 643.307292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
17032024-12-13T23:00:14.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150") failed: Property not found. retry in 1.140750992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
17042024-12-13T23:00:14.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92") failed: Property not found. retry in 821.721556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
17052024-12-13T23:00:14.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e") failed: Property not found. retry in 1.19821898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
17062024-12-13T23:00:14.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d") failed: Property not found. retry in 567.159827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
17072024-12-13T23:00:14.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662") failed: Property not found. retry in 928.719798ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
17082024-12-13T23:00:15.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5") failed: Property not found. retry in 1.120438479s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
17092024-12-13T23:00:15.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153") failed: Property not found. retry in 711.539446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
17102024-12-13T23:00:15.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0") failed: Property not found. retry in 945.68355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
17112024-12-13T23:00:15.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695") failed: Property not found. retry in 1.054691873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
17122024-12-13T23:00:15.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32") failed: Property not found. retry in 634.370256ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
17132024-12-13T23:00:15.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43") failed: Property not found. retry in 1.04935922s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
17142024-12-13T23:00:15.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76") failed: Property not found. retry in 980.478836ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
17152024-12-13T23:00:15.262ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.824048193s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
17162024-12-13T23:00:15.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 1.035661076s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
17172024-12-13T23:00:16.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 863.750276ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
17182024-12-13T23:00:17.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 874.911587ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
17192024-12-13T23:00:18.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0") failed: Property not found. retry in 818.430628ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
17202024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_0e30334a-3d4a-4136-bcbb-dc5014d497a8
17212024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a817d1e7-6c11-4e34-9b70-c17a5904aca0
17222024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_f5dd1daa-052c-4891-ac90-a51f60320942
17232024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_3bcfc5b9-4c22-408c-a69d-b35ff40dc662
17242024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_ede3dd84-e6a9-4e76-ba9d-d388d6664cb5
17252024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_fd3d6a74-47d0-4e20-8d4f-c289afdf1c32
17262024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_2e5a072c-56d8-43b5-b043-0f7b102649d0
17272024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_11077c37-531c-45bb-8afe-a287cca74695
17282024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_9e14c1a1-8561-454f-a886-01216a157150
17292024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_04a3334b-9752-441b-939b-8e2c1e79fc9b
17302024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_59dbba2f-8e07-41f2-9c4c-cdb411b5f153
17312024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f45a11e5-1389-48be-9ad5-cf9605c32a2e
17322024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_6cff243c-1194-49e7-b500-93b1843b510d
17332024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_0609f269-d5d8-4901-a399-2298bf60524f
17342024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_8fb90a28-bdec-45a7-95c7-b65381216e92
17352024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_4c5c2ead-0193-4378-96e2-af2730e9ff43
17362024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_79f97b1c-5adc-4433-8fb3-694c98815b76
17372024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_2593bc8a-e55b-4e27-81cb-9a9d1cdebaa7
17382024-12-13T23:00:19.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_51090476-4cb4-4299-81dd-872e93ca7475
17392024-12-13T23:00:19.163ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17402024-12-13T23:00:19.165ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17412024-12-13T23:00:19.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42164128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58121 req_id = 13d950d3-e6eb-467f-a0d4-db2cf9873e98 response_code = 204 uri = /omicron-zones
17422024-12-13T23:00:19.189ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17432024-12-13T23:00:19.204ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17442024-12-13T23:00:19.215ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
17452024-12-13T23:00:19.259ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17462024-12-13T23:00:19.999ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17472024-12-13T23:00:20.076ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17482024-12-13T23:00:20.204ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17492024-12-13T23:00:20.308ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17502024-12-13T23:00:20.463ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17512024-12-13T23:00:20.720ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17522024-12-13T23:00:20.904ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17532024-12-13T23:00:21.119ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17542024-12-13T23:00:21.120ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.694867071s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
17552024-12-13T23:00:21.375ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17562024-12-13T23:00:21.676ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17572024-12-13T23:00:21.976ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17582024-12-13T23:00:22.639ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17592024-12-13T23:00:23.329ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/ab5f3f90-9631-40a3-aa5d-74a5ed48ca25/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17602024-12-13T23:00:26.155ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b09ca2c4-6ff0-49d5-9bfe-3d0a6dcb4409", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"ab5f3f90-9631-40a3-aa5d-74a5ed48ca25\"", request_id: "b09ca2c4-6ff0-49d5-9bfe-3d0a6dcb4409" } file = sled-agent/src/rack_setup/service.rs:1078
17612024-12-13T23:00:26.991ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62955
17622024-12-13T23:00:26.991ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62955 req_id = 98ca4131-c277-4a83-9942-d7488514bc1f response_code = 200 uri = /baseboard
17632024-12-13T23:00:27.299ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "676297e6-3c8b-4444-a779-ee5f14887863", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"ab5f3f90-9631-40a3-aa5d-74a5ed48ca25\"", request_id: "676297e6-3c8b-4444-a779-ee5f14887863" } file = sled-agent/src/rack_setup/service.rs:1078
17642024-12-13T23:00:30.714ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1bb7665b-5b6a-4f85-b0e7-7df9a6f4724b", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c991c27b-85ad-498c-8a93-464bd3ce406f\"", request_id: "1bb7665b-5b6a-4f85-b0e7-7df9a6f4724b" } file = sled-agent/src/rack_setup/service.rs:1078
17652024-12-13T23:00:33.323ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e62ae1d8-466a-4e66-989d-d4509cbaff5b", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c991c27b-85ad-498c-8a93-464bd3ce406f\"", request_id: "e62ae1d8-466a-4e66-989d-d4509cbaff5b" } file = sled-agent/src/rack_setup/service.rs:1078
17662024-12-13T23:00:36.129ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "188cb3d3-f0a5-4cd6-8bfa-c91e1d75ae3d", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c991c27b-85ad-498c-8a93-464bd3ce406f\"", request_id: "188cb3d3-f0a5-4cd6-8bfa-c91e1d75ae3d" } file = sled-agent/src/rack_setup/service.rs:1078
17672024-12-13T23:00:39.089ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c24dd307-5cbc-4abe-a17c-e353f45a6a51", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c991c27b-85ad-498c-8a93-464bd3ce406f\"", request_id: "c24dd307-5cbc-4abe-a17c-e353f45a6a51" } file = sled-agent/src/rack_setup/service.rs:1078
17682024-12-13T23:00:41.114ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "532d6257-8cea-4d9e-9c25-252b8cf7892c", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c991c27b-85ad-498c-8a93-464bd3ce406f\"", request_id: "532d6257-8cea-4d9e-9c25-252b8cf7892c" } file = sled-agent/src/rack_setup/service.rs:1078
17692024-12-13T23:00:45.140ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "121e0ce4-dce4-4505-af2e-1c719a342990", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c991c27b-85ad-498c-8a93-464bd3ce406f\"", request_id: "121e0ce4-dce4-4505-af2e-1c719a342990" } file = sled-agent/src/rack_setup/service.rs:1078
17702024-12-13T23:00:50.449ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c1a89cf8-c05c-43f5-9f26-e8cfd5e076ae", "content-length": "173", "date": "Fri, 13 Dec 2024 23:00:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c991c27b-85ad-498c-8a93-464bd3ce406f\"", request_id: "c1a89cf8-c05c-43f5-9f26-e8cfd5e076ae" } file = sled-agent/src/rack_setup/service.rs:1078
17712024-12-13T23:00:51.675ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
17722024-12-13T23:00:51.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58059
17732024-12-13T23:00:51.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
17742024-12-13T23:00:51.780ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
17752024-12-13T23:00:51.781ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:177
17762024-12-13T23:00:51.782ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:177
17772024-12-13T23:00:51.797ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17782024-12-13T23:00:51.797ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_f7cfdce7-5264-4421-96d5-85418ddb748d
17792024-12-13T23:00:51.823ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17802024-12-13T23:00:51.823ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_cb54037f-125a-4af3-8595-b53b9b45d26a
17812024-12-13T23:00:51.847ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17822024-12-13T23:00:51.847ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_7ecf842b-e498-4351-b151-8dff95453908
17832024-12-13T23:00:51.870ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17842024-12-13T23:00:51.870ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_27177673-3a08-4285-914d-2d0755afcc21
17852024-12-13T23:00:51.893ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17862024-12-13T23:00:51.893ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b
17872024-12-13T23:00:51.916ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17882024-12-13T23:00:51.916ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_46df782d-5e10-4410-8b6c-9b413351c0ef
17892024-12-13T23:00:51.939ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17902024-12-13T23:00:51.939ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c
17912024-12-13T23:00:51.962ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17922024-12-13T23:00:51.962ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_66612a50-feea-47ce-a70f-e7d816b9348f
17932024-12-13T23:00:51.986ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
17942024-12-13T23:00:51.986ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785
17952024-12-13T23:00:51.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58059 req_id = b427f434-fa5a-46e4-9fd6-1549a3041f65 response_code = 200 uri = /inventory
17962024-12-13T23:00:56.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41988
17972024-12-13T23:00:56.829ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17982024-12-13T23:00:56.829ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17992024-12-13T23:00:56.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18002024-12-13T23:00:56.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18012024-12-13T23:00:56.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18022024-12-13T23:00:56.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18032024-12-13T23:00:56.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18042024-12-13T23:00:56.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5404 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41988 req_id = 0ff1c684-ceb0-4c4d-8e26-78334048f6f8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18052024-12-13T23:00:56.832ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
18062024-12-13T23:00:56.836ZINFOSledAgent (RSS): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18072024-12-13T23:00:56.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64112
18082024-12-13T23:00:56.836ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18092024-12-13T23:00:56.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18102024-12-13T23:00:56.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18112024-12-13T23:00:56.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18122024-12-13T23:00:56.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18132024-12-13T23:00:56.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18142024-12-13T23:00:56.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18152024-12-13T23:00:56.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64112 req_id = 9d1434a1-deba-4fac-8f08-cb4057d443e4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18162024-12-13T23:00:56.837ZINFOSledAgent (RSS): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18172024-12-13T23:00:57.025ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57133
18182024-12-13T23:00:57.026ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57133 req_id = dd30f69a-42c5-46f8-9ef1-9bed3817abb7 response_code = 200 uri = /baseboard
18192024-12-13T23:00:57.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64636
18202024-12-13T23:00:57.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
18212024-12-13T23:00:57.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
18222024-12-13T23:00:57.230ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:177
18232024-12-13T23:00:57.230ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:177
18242024-12-13T23:00:57.242ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18252024-12-13T23:00:57.242ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_f7cfdce7-5264-4421-96d5-85418ddb748d
18262024-12-13T23:00:57.264ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18272024-12-13T23:00:57.264ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_cb54037f-125a-4af3-8595-b53b9b45d26a
18282024-12-13T23:00:57.286ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18292024-12-13T23:00:57.286ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_7ecf842b-e498-4351-b151-8dff95453908
18302024-12-13T23:00:57.308ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18312024-12-13T23:00:57.308ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_27177673-3a08-4285-914d-2d0755afcc21
18322024-12-13T23:00:57.328ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18332024-12-13T23:00:57.328ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b
18342024-12-13T23:00:57.348ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18352024-12-13T23:00:57.348ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_46df782d-5e10-4410-8b6c-9b413351c0ef
18362024-12-13T23:00:57.367ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18372024-12-13T23:00:57.367ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c
18382024-12-13T23:00:57.387ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18392024-12-13T23:00:57.387ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_66612a50-feea-47ce-a70f-e7d816b9348f
18402024-12-13T23:00:57.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
18412024-12-13T23:00:57.409ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785
18422024-12-13T23:00:57.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64636 req_id = 8a9275f8-e9c3-420f-9c0a-7119c32cb58e response_code = 200 uri = /inventory
18432024-12-13T23:00:57.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39735
18442024-12-13T23:00:57.807ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18452024-12-13T23:00:57.807ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18462024-12-13T23:00:57.807ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18472024-12-13T23:00:57.807ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18482024-12-13T23:00:57.807ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18492024-12-13T23:00:57.807ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18502024-12-13T23:00:57.807ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18512024-12-13T23:00:57.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39735 req_id = 2592be71-f599-4a44-b84d-90acf24171e4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18522024-12-13T23:00:58.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54874
18532024-12-13T23:00:58.372ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18542024-12-13T23:00:58.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18552024-12-13T23:00:58.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18562024-12-13T23:00:58.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18572024-12-13T23:00:58.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18582024-12-13T23:00:58.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18592024-12-13T23:00:58.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18602024-12-13T23:00:58.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54874 req_id = 0d49fb9b-01f2-4533-96f4-05cb63140c48 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18612024-12-13T23:00:58.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50408
18622024-12-13T23:00:58.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1040 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50408 req_id = a9c9e3c6-fa80-412a-94a4-eb9e1e0a9054 response_code = 200 uri = /vpc-routes
18632024-12-13T23:00:59.097ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
18642024-12-13T23:00:59.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1558 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50408 req_id = 7846af71-8254-4c79-9b91-443fcbd8b36e response_code = 204 uri = /eip-gateways
18652024-12-13T23:00:59.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56532
18662024-12-13T23:00:59.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56532 req_id = c1588681-ae80-4226-88dd-7f8d4650943e response_code = 200 uri = /vpc-routes
18672024-12-13T23:00:59.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35135
18682024-12-13T23:00:59.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35135 req_id = 0d453934-e9fb-4349-ba17-df1791f19e1a response_code = 200 uri = /v2p
18692024-12-13T23:00:59.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44345
18702024-12-13T23:00:59.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18712024-12-13T23:00:59.524ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18722024-12-13T23:00:59.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158393 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44345 req_id = 5bc80d94-7799-4288-a45f-eb7bf03cf32c response_code = 204 uri = /switch-ports
18732024-12-13T23:00:59.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36426
18742024-12-13T23:00:59.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
18752024-12-13T23:00:59.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56532 req_id = 8828d267-cc78-4da5-a5f8-0d6b298cd905 response_code = 204 uri = /eip-gateways
18762024-12-13T23:00:59.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36426 req_id = 9079c351-8271-4dae-b731-a111d5b34981 response_code = 200 uri = /v2p
18772024-12-13T23:00:59.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 875 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44345 req_id = 8fc5bacc-1339-4426-aed9-ebcbf7e64573 response_code = 200 uri = /network-bootstore-config
18782024-12-13T23:00:59.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50408 req_id = ffdf4116-fadd-43e4-984b-ee60115718f6 response_code = 204 uri = /vpc-routes
18792024-12-13T23:00:59.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54290
18802024-12-13T23:00:59.644ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18812024-12-13T23:00:59.688ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18822024-12-13T23:00:59.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54290 req_id = e393a188-0a6f-437a-9b27-4ce8d5af93a9 response_code = 204 uri = /switch-ports
18832024-12-13T23:00:59.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63038
18842024-12-13T23:00:59.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63038 req_id = 34e90cbf-0b47-40dc-873f-070fe262368d response_code = 200 uri = /vpc-routes
18852024-12-13T23:00:59.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54290 req_id = 90e0ec7a-9452-45c7-b918-6f0d4d7aa3af response_code = 200 uri = /network-bootstore-config
18862024-12-13T23:00:59.757ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18872024-12-13T23:00:59.758ZINFOSledAgent (bootstore): Writing ledger to /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18882024-12-13T23:00:59.759ZINFOSledAgent (bootstore): Writing ledger to /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18892024-12-13T23:00:59.760ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18902024-12-13T23:00:59.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3666 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44345 req_id = 06c54227-ab1a-475f-bf64-60048e3968f3 response_code = 204 uri = /network-bootstore-config
18912024-12-13T23:00:59.784ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
18922024-12-13T23:00:59.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56532 req_id = 45be6e1b-e38a-4d5f-b60d-e39b80e440de response_code = 204 uri = /vpc-routes
18932024-12-13T23:00:59.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
18942024-12-13T23:00:59.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63038 req_id = d0509c4a-ce40-4554-9175-6b4afeb1ad2b response_code = 204 uri = /eip-gateways
18952024-12-13T23:00:59.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63038 req_id = 72fec4d6-3e54-4193-9f1b-0e730556b215 response_code = 204 uri = /vpc-routes
18962024-12-13T23:00:59.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64606
18972024-12-13T23:00:59.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64606 req_id = ebb24d24-396c-4829-b33f-2f9a85ba19d6 response_code = 200 uri = /v2p
18982024-12-13T23:01:00.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54160
18992024-12-13T23:01:00.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19002024-12-13T23:01:00.058ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19012024-12-13T23:01:00.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54160 req_id = 042ba607-9506-4870-977f-4a1716360090 response_code = 204 uri = /switch-ports
19022024-12-13T23:01:00.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54160 req_id = f6346b77-591c-4661-a78f-7023180eea8c response_code = 200 uri = /network-bootstore-config
19032024-12-13T23:01:03.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59475
19042024-12-13T23:01:03.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59475 req_id = 60ff1b6a-416a-4210-adc3-650961b2eb22 response_code = 200 uri = /vpc-routes
19052024-12-13T23:01:03.909ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
19062024-12-13T23:01:03.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59475 req_id = fd9a5171-d28e-4f2c-ad1c-cc7e0c22938b response_code = 204 uri = /eip-gateways
19072024-12-13T23:01:03.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59475 req_id = d56c9a0b-6e03-4e84-8d90-446a6a6671b5 response_code = 204 uri = /vpc-routes
19082024-12-13T23:01:10.764ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:46200 remote_addr = [fd00:1122:3344:101::d]:60974 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
19092024-12-13T23:01:10.797ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31206 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 092c0b0b-afaf-4b14-bee5-f101456017da response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
19102024-12-13T23:01:27.065ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53296
19112024-12-13T23:01:27.065ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53296 req_id = 0cab1b8b-45a0-4b2a-8372-8acea2d5c6ec response_code = 200 uri = /baseboard
19122024-12-13T23:01:29.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52104
19132024-12-13T23:01:29.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52104 req_id = c1a84956-2b63-4f55-adc6-3bce04b38bcb response_code = 200 uri = /vpc-routes
19142024-12-13T23:01:29.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
19152024-12-13T23:01:29.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52104 req_id = 278f5eff-d983-4094-ac67-681fd3c279c0 response_code = 204 uri = /eip-gateways
19162024-12-13T23:01:29.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52104 req_id = 218c6383-0ada-42bf-8d0b-0fceb3706493 response_code = 204 uri = /vpc-routes
19172024-12-13T23:01:29.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64669
19182024-12-13T23:01:29.380ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19192024-12-13T23:01:29.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19202024-12-13T23:01:29.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64669 req_id = ad5fa02b-21ed-429c-8fda-17434eb2e366 response_code = 204 uri = /switch-ports
19212024-12-13T23:01:29.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39515
19222024-12-13T23:01:29.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44870
19232024-12-13T23:01:29.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53608
19242024-12-13T23:01:29.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64669 req_id = 825e220e-fe19-462e-9530-509f7b128c20 response_code = 200 uri = /network-bootstore-config
19252024-12-13T23:01:29.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39515 req_id = e81e6e3e-0de0-4be1-9fe2-900db27bf230 response_code = 200 uri = /vpc-routes
19262024-12-13T23:01:29.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53608 req_id = 652485a7-2d0c-4e54-8b31-336d5ef66692 response_code = 200 uri = /v2p
19272024-12-13T23:01:29.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44870 req_id = cc4e9905-b8ef-49f4-ab04-67852616f54f response_code = 200 uri = /v2p
19282024-12-13T23:01:29.539ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
19292024-12-13T23:01:29.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39515 req_id = c84cf850-9af6-42d5-9987-d25e99cffd70 response_code = 204 uri = /eip-gateways
19302024-12-13T23:01:29.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34892
19312024-12-13T23:01:29.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34892 req_id = 4b10a50a-6804-4766-a13e-6aab5c594033 response_code = 200 uri = /vpc-routes
19322024-12-13T23:01:29.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39515 req_id = e909417f-c5a9-4791-8c7b-9c1a517974a8 response_code = 204 uri = /vpc-routes
19332024-12-13T23:01:29.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34759
19342024-12-13T23:01:29.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19352024-12-13T23:01:29.614ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19362024-12-13T23:01:29.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34759 req_id = 91efd3d0-2499-4cf7-bf10-22cf7174c162 response_code = 204 uri = /switch-ports
19372024-12-13T23:01:29.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60416
19382024-12-13T23:01:29.668ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
19392024-12-13T23:01:29.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34892 req_id = 7979de11-44c2-4c02-bc4b-052997f357cd response_code = 204 uri = /eip-gateways
19402024-12-13T23:01:29.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3719 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34759 req_id = a1418236-2668-4c5d-8359-2bd168c7b913 response_code = 200 uri = /network-bootstore-config
19412024-12-13T23:01:29.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3875 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60416 req_id = dad04881-6aae-47a8-8ca5-b559090c2ab0 response_code = 200 uri = /v2p
19422024-12-13T23:01:29.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34892 req_id = d52601c2-627f-4380-9eb9-08a8b68a599f response_code = 204 uri = /vpc-routes
19432024-12-13T23:01:29.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41580
19442024-12-13T23:01:29.819ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19452024-12-13T23:01:29.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19462024-12-13T23:01:29.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41580 req_id = 7f2e95dd-98e0-45ed-90d0-834314e2dbcf response_code = 204 uri = /switch-ports
19472024-12-13T23:01:29.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41580 req_id = 1b504e5b-caa3-4bdc-be3f-1f5b1a74b915 response_code = 200 uri = /network-bootstore-config
19482024-12-13T23:01:40.771ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7153 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 4e284860-18a6-498c-b1b3-5a020f8511dd response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
19492024-12-13T23:01:57.099ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58711
19502024-12-13T23:01:57.099ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58711 req_id = f8fed260-fe48-4a65-92a7-52363995db52 response_code = 200 uri = /baseboard
19512024-12-13T23:01:59.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55298
19522024-12-13T23:01:59.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55298 req_id = 859f63b3-18e2-431f-9b6b-de22d7adaab7 response_code = 200 uri = /vpc-routes
19532024-12-13T23:01:59.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45259
19542024-12-13T23:01:59.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45259 req_id = b7454184-f742-49fa-85b7-b476cb9366e3 response_code = 200 uri = /v2p
19552024-12-13T23:01:59.142ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
19562024-12-13T23:01:59.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55298 req_id = e65b818e-66e8-4b49-97ab-43d351ea61ad response_code = 204 uri = /eip-gateways
19572024-12-13T23:01:59.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55298 req_id = c6f8f53e-16f6-4c17-8841-917b91d632ad response_code = 204 uri = /vpc-routes
19582024-12-13T23:01:59.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50250
19592024-12-13T23:01:59.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50250 req_id = 56230d9d-df67-4d35-86b5-f576c89a1bbc response_code = 200 uri = /v2p
19602024-12-13T23:01:59.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43302
19612024-12-13T23:01:59.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43302 req_id = 82973db0-28ee-40b5-b693-97d8cc4241b0 response_code = 200 uri = /vpc-routes
19622024-12-13T23:01:59.289ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
19632024-12-13T23:01:59.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43302 req_id = 3c9d8e4f-df89-44c0-a0f4-04f8244d52bf response_code = 204 uri = /eip-gateways
19642024-12-13T23:01:59.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40073
19652024-12-13T23:01:59.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40073 req_id = ce6b3907-c892-45ea-8cfd-58621b316ffd response_code = 200 uri = /vpc-routes
19662024-12-13T23:01:59.356ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
19672024-12-13T23:01:59.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40073 req_id = 82282ba4-0e72-4ffe-a902-a94ed2e30472 response_code = 204 uri = /eip-gateways
19682024-12-13T23:01:59.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40073 req_id = cee56bf9-58e0-4b39-ace6-8f36800886a6 response_code = 204 uri = /vpc-routes
19692024-12-13T23:01:59.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43302 req_id = 23dce868-baac-44f0-8cda-ab6416b9a4d4 response_code = 204 uri = /vpc-routes
19702024-12-13T23:01:59.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59986
19712024-12-13T23:01:59.418ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19722024-12-13T23:01:59.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19732024-12-13T23:01:59.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102529 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59986 req_id = 929381e4-ff65-4fb1-a886-17f9acad877c response_code = 204 uri = /switch-ports
19742024-12-13T23:01:59.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50117
19752024-12-13T23:01:59.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45169
19762024-12-13T23:01:59.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59986 req_id = 0701be12-1a9e-41ce-a423-21c26e35e942 response_code = 200 uri = /network-bootstore-config
19772024-12-13T23:01:59.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19782024-12-13T23:01:59.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50117 req_id = 741504dc-e7e7-4a95-a157-a0925d1516d8 response_code = 200 uri = /v2p
19792024-12-13T23:01:59.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19802024-12-13T23:01:59.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45169 req_id = 9645d6d9-bd2d-4485-8cd4-a1b66beb6537 response_code = 204 uri = /switch-ports
19812024-12-13T23:01:59.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45169 req_id = 5f3b1be8-920d-48b2-853c-83abd6fa7681 response_code = 200 uri = /network-bootstore-config
19822024-12-13T23:01:59.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56941
19832024-12-13T23:01:59.776ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19842024-12-13T23:01:59.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19852024-12-13T23:01:59.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56941 req_id = d5986515-68fc-425a-acf9-21f0deb22082 response_code = 204 uri = /switch-ports
19862024-12-13T23:01:59.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56941 req_id = 64d22c65-1738-4275-aa8d-286e82e66a33 response_code = 200 uri = /network-bootstore-config
19872024-12-13T23:02:10.771ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7233 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 907c67cd-b285-4221-8e2d-bcce62e1964f response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
19882024-12-13T23:02:27.132ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53531
19892024-12-13T23:02:27.132ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53531 req_id = d410cb5f-c372-47b4-92ce-c3f9084c9f7a response_code = 200 uri = /baseboard
19902024-12-13T23:02:29.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55092
19912024-12-13T23:02:29.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55092 req_id = 2d360299-6475-4416-8cdd-44cd542fe09c response_code = 200 uri = /vpc-routes
19922024-12-13T23:02:29.136ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
19932024-12-13T23:02:29.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55092 req_id = 9b9b2e90-9fc6-42f7-8780-022071bb9320 response_code = 204 uri = /eip-gateways
19942024-12-13T23:02:29.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55092 req_id = 5672e794-b1f0-491d-8571-dda9ad40adac response_code = 204 uri = /vpc-routes
19952024-12-13T23:02:29.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38634
19962024-12-13T23:02:29.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38634 req_id = e36e5e7f-775a-4379-8d7a-97f1f829d17f response_code = 200 uri = /v2p
19972024-12-13T23:02:29.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41556
19982024-12-13T23:02:29.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41556 req_id = bd38f78f-3ce7-47ca-8488-f27c1e2d1abf response_code = 200 uri = /v2p
19992024-12-13T23:02:29.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58854
20002024-12-13T23:02:29.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58854 req_id = f80ee375-2be0-41b2-b6ab-dfaab428fcdd response_code = 200 uri = /vpc-routes
20012024-12-13T23:02:29.378ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
20022024-12-13T23:02:29.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58854 req_id = f34225cc-65c5-42d9-ac1f-c20cc7d40fa3 response_code = 204 uri = /eip-gateways
20032024-12-13T23:02:29.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58854 req_id = 03e46667-44d7-4e29-8e83-2ce9dcb3cba8 response_code = 204 uri = /vpc-routes
20042024-12-13T23:02:29.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46075
20052024-12-13T23:02:29.412ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20062024-12-13T23:02:29.452ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20072024-12-13T23:02:29.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46075 req_id = 559ca01c-d136-4fcb-b08f-bc802fea6169 response_code = 204 uri = /switch-ports
20082024-12-13T23:02:29.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44478
20092024-12-13T23:02:29.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47379
20102024-12-13T23:02:29.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20112024-12-13T23:02:29.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44478 req_id = d14689be-de86-4649-b573-00e1e6c7ed21 response_code = 200 uri = /vpc-routes
20122024-12-13T23:02:29.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46075 req_id = 7e264085-26f2-4b74-8815-b6d79cfeab73 response_code = 200 uri = /network-bootstore-config
20132024-12-13T23:02:29.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20142024-12-13T23:02:29.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
20152024-12-13T23:02:29.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44478 req_id = 0b1493fb-e003-4d30-8b9e-bb23cac24773 response_code = 204 uri = /eip-gateways
20162024-12-13T23:02:29.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44478 req_id = 3e8cbd16-2de0-4bb6-9ce0-298c89ae854b response_code = 204 uri = /vpc-routes
20172024-12-13T23:02:29.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85530 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47379 req_id = 2f717bdd-596c-4f25-8b0b-5d5d7fda2270 response_code = 204 uri = /switch-ports
20182024-12-13T23:02:29.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47379 req_id = ee0d5a96-d3a5-4dd6-8ec7-79888e0b0690 response_code = 200 uri = /network-bootstore-config
20192024-12-13T23:02:29.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60124
20202024-12-13T23:02:29.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60124 req_id = 4956968d-ed0d-4e61-929e-fc5a5531c629 response_code = 200 uri = /v2p
20212024-12-13T23:02:29.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44031
20222024-12-13T23:02:29.748ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20232024-12-13T23:02:29.780ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20242024-12-13T23:02:29.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78552 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44031 req_id = e241ced3-0d37-4cc9-a54b-30387413ce69 response_code = 204 uri = /switch-ports
20252024-12-13T23:02:29.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44031 req_id = 336c5433-91d0-4801-b29a-80c2c862adfb response_code = 200 uri = /network-bootstore-config
20262024-12-13T23:02:40.771ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7338 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = c8e03b53-9430-4581-8e3d-3dc071f2bfcf response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
20272024-12-13T23:02:57.166ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57796
20282024-12-13T23:02:57.166ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57796 req_id = f7af85a6-ce41-4046-8127-45db0882a4a4 response_code = 200 uri = /baseboard
20292024-12-13T23:02:59.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58892
20302024-12-13T23:02:59.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58892 req_id = ce0f67d5-eb54-4259-b58a-a153f1e8abf4 response_code = 200 uri = /vpc-routes
20312024-12-13T23:02:59.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64742
20322024-12-13T23:02:59.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64742 req_id = dde3e301-c822-468e-86e9-81fcf3d2d95c response_code = 200 uri = /v2p
20332024-12-13T23:02:59.161ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
20342024-12-13T23:02:59.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58892 req_id = 85e470b5-5fa1-4df1-9f75-5cfaad41ff89 response_code = 204 uri = /eip-gateways
20352024-12-13T23:02:59.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58892 req_id = 6812363d-cf96-4d37-87a8-1a72966b7f01 response_code = 204 uri = /vpc-routes
20362024-12-13T23:02:59.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45797
20372024-12-13T23:02:59.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45797 req_id = 1287c81a-4d35-44e0-9ff8-32bfeb5d5724 response_code = 200 uri = /vpc-routes
20382024-12-13T23:02:59.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40335
20392024-12-13T23:02:59.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40335 req_id = 83e58e08-32c6-4ee8-a7b4-5fd3e332e254 response_code = 200 uri = /vpc-routes
20402024-12-13T23:02:59.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
20412024-12-13T23:02:59.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45797 req_id = 748e98ab-a5f6-4649-9f34-a54df33b734a response_code = 204 uri = /eip-gateways
20422024-12-13T23:02:59.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45797 req_id = a2a142a9-eb4c-4ef1-9183-3b000c360a62 response_code = 204 uri = /vpc-routes
20432024-12-13T23:02:59.411ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
20442024-12-13T23:02:59.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40335 req_id = 5ace3fdb-403f-45fc-a385-cc3c0461d1e4 response_code = 204 uri = /eip-gateways
20452024-12-13T23:02:59.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51128
20462024-12-13T23:02:59.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51128 req_id = 05261bec-d08b-425c-9c63-9ad12141ecff response_code = 200 uri = /v2p
20472024-12-13T23:02:59.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48799
20482024-12-13T23:02:59.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20492024-12-13T23:02:59.521ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20502024-12-13T23:02:59.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96894 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48799 req_id = 1d17aa70-f0cf-48cb-8932-197da5bba880 response_code = 204 uri = /switch-ports
20512024-12-13T23:02:59.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34722
20522024-12-13T23:02:59.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34236
20532024-12-13T23:02:59.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48799 req_id = 6ec62fba-2ef8-4756-8472-9ee616f2ca15 response_code = 200 uri = /network-bootstore-config
20542024-12-13T23:02:59.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34236 req_id = a45e81ae-498f-41e5-b188-504c8d67eac9 response_code = 200 uri = /v2p
20552024-12-13T23:02:59.579ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20562024-12-13T23:02:59.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40335 req_id = 131a602d-02ce-465c-b1ee-6e9ca4a1ae46 response_code = 204 uri = /vpc-routes
20572024-12-13T23:02:59.618ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20582024-12-13T23:02:59.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48750
20592024-12-13T23:02:59.675ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20602024-12-13T23:02:59.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96247 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34722 req_id = 4521e8c3-5876-4972-965f-d593ca8d429c response_code = 204 uri = /switch-ports
20612024-12-13T23:02:59.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 708 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34722 req_id = dd8454bc-25ca-48a5-922d-2b867472f59c response_code = 200 uri = /network-bootstore-config
20622024-12-13T23:02:59.709ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20632024-12-13T23:02:59.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100303 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48750 req_id = a6f2a25b-56b5-4de5-9d1f-7ceece673c8e response_code = 204 uri = /switch-ports
20642024-12-13T23:02:59.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48750 req_id = 75f6d9e3-387a-450f-a9a6-17d06042174b response_code = 200 uri = /network-bootstore-config
20652024-12-13T23:03:10.773ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9652 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 49f1df79-b7ab-410a-83d0-1bd400aa300f response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
20662024-12-13T23:03:20.460ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20672024-12-13T23:03:27.200ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38447
20682024-12-13T23:03:27.200ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38447 req_id = d556c44e-6376-48cf-a9f7-fb73a039b61b response_code = 200 uri = /baseboard
20692024-12-13T23:03:29.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37201
20702024-12-13T23:03:29.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37201 req_id = bd76c12c-e02b-4d96-b684-2a0f2bb3395a response_code = 200 uri = /v2p
20712024-12-13T23:03:29.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51705
20722024-12-13T23:03:29.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51705 req_id = 754df326-b373-4f8d-ba33-60922dbc7d05 response_code = 200 uri = /vpc-routes
20732024-12-13T23:03:29.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50585
20742024-12-13T23:03:29.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50585 req_id = ea1d95ba-2563-4bfb-8dec-b308abb47a8d response_code = 200 uri = /vpc-routes
20752024-12-13T23:03:29.297ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
20762024-12-13T23:03:29.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51705 req_id = 7bf3a7d2-4ff0-4a86-b0a4-fe8d9fb6bfdb response_code = 204 uri = /eip-gateways
20772024-12-13T23:03:29.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51705 req_id = 95680ea8-f3c7-4968-b0af-e15feea3aa17 response_code = 204 uri = /vpc-routes
20782024-12-13T23:03:29.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
20792024-12-13T23:03:29.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50585 req_id = fe62fdd3-2431-4b18-8dd2-e1a1251d5021 response_code = 204 uri = /eip-gateways
20802024-12-13T23:03:29.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50585 req_id = 6625b6d6-738e-4028-95ac-f3bc3738674c response_code = 204 uri = /vpc-routes
20812024-12-13T23:03:29.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41283
20822024-12-13T23:03:29.453ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20832024-12-13T23:03:29.492ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20842024-12-13T23:03:29.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91053 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41283 req_id = 33202134-8bf1-4578-b4a0-b5709a52a387 response_code = 204 uri = /switch-ports
20852024-12-13T23:03:29.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40728
20862024-12-13T23:03:29.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59620
20872024-12-13T23:03:29.545ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20882024-12-13T23:03:29.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40728 req_id = 924fe1eb-bc53-4180-b0b1-de281e6185f9 response_code = 200 uri = /v2p
20892024-12-13T23:03:29.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41283 req_id = 51b9d410-7830-4d36-a389-66db13c06b7e response_code = 200 uri = /network-bootstore-config
20902024-12-13T23:03:29.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58212
20912024-12-13T23:03:29.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58212 req_id = 08a4d125-e91c-4125-9b74-4820d03c35ca response_code = 200 uri = /vpc-routes
20922024-12-13T23:03:29.581ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20932024-12-13T23:03:29.630ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
20942024-12-13T23:03:29.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58212 req_id = 62cb2a21-7a9f-4f4c-9087-64c1f603fa04 response_code = 204 uri = /eip-gateways
20952024-12-13T23:03:29.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59620 req_id = 23c62cc3-fc35-48dc-aa63-ba8e4d6a35cc response_code = 204 uri = /switch-ports
20962024-12-13T23:03:29.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59620 req_id = 07d45aed-b718-4d2b-9d93-a4ef538647e6 response_code = 200 uri = /network-bootstore-config
20972024-12-13T23:03:29.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54109
20982024-12-13T23:03:29.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54109 req_id = 30c13b0b-8a59-4b65-afcb-50647f6faf64 response_code = 200 uri = /v2p
20992024-12-13T23:03:29.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58212 req_id = 978005da-4d9e-4320-a939-302457efbf24 response_code = 204 uri = /vpc-routes
21002024-12-13T23:03:29.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57093
21012024-12-13T23:03:29.663ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21022024-12-13T23:03:29.701ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21032024-12-13T23:03:29.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93981 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57093 req_id = 787bb530-2bf0-4707-9b24-1e08c3860acc response_code = 204 uri = /switch-ports
21042024-12-13T23:03:29.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57093 req_id = 868b971f-bf7e-4bb6-8e0b-2c734c31474d response_code = 200 uri = /network-bootstore-config
21052024-12-13T23:03:40.770ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6786 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = d97bfa3c-afed-4b72-b2c6-d38c8da30df8 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
21062024-12-13T23:03:57.247ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36748
21072024-12-13T23:03:57.247ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36748 req_id = 488fd344-217d-490d-8df7-7a9213852c45 response_code = 200 uri = /baseboard
21082024-12-13T23:03:59.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59607
21092024-12-13T23:03:59.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59607 req_id = 20fcb389-85c6-40b9-a5fe-f23ea358a7e0 response_code = 200 uri = /vpc-routes
21102024-12-13T23:03:59.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
21112024-12-13T23:03:59.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59607 req_id = 317bfcc2-d887-4685-8cb0-1022e9494b4b response_code = 204 uri = /eip-gateways
21122024-12-13T23:03:59.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36050
21132024-12-13T23:03:59.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36050 req_id = ee5cb183-28dd-4bc2-a06a-5bf32ac8cc4e response_code = 200 uri = /v2p
21142024-12-13T23:03:59.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59607 req_id = 8e6901a1-d856-4492-b26f-942d6cdfb1a2 response_code = 204 uri = /vpc-routes
21152024-12-13T23:03:59.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59333
21162024-12-13T23:03:59.140ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21172024-12-13T23:03:59.179ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21182024-12-13T23:03:59.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59333 req_id = 45c214ca-283f-4513-8946-ec7a7f74d03b response_code = 204 uri = /switch-ports
21192024-12-13T23:03:59.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61590
21202024-12-13T23:03:59.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47804
21212024-12-13T23:03:59.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59333 req_id = 3447710a-cc98-4693-894c-78749c503c73 response_code = 200 uri = /network-bootstore-config
21222024-12-13T23:03:59.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61590 req_id = 17f2a3fe-6b56-4211-9bf2-cd566d9e9e44 response_code = 200 uri = /vpc-routes
21232024-12-13T23:03:59.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47804 req_id = 4d685508-0c70-48d4-b1b5-a6284a2de32b response_code = 200 uri = /v2p
21242024-12-13T23:03:59.307ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
21252024-12-13T23:03:59.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61590 req_id = cc06a0dc-4d18-4701-b3ce-a940af6aee4e response_code = 204 uri = /eip-gateways
21262024-12-13T23:03:59.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61590 req_id = 9752f1ba-e2fe-4ccf-a715-5653e88091ca response_code = 204 uri = /vpc-routes
21272024-12-13T23:03:59.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41442
21282024-12-13T23:03:59.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21292024-12-13T23:03:59.362ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21302024-12-13T23:03:59.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41442 req_id = 92fe581e-f8c3-4781-977d-610c8b7445c4 response_code = 204 uri = /switch-ports
21312024-12-13T23:03:59.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41053
21322024-12-13T23:03:59.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41053 req_id = 73257c7b-4611-4615-8f16-56343eb86a5a response_code = 200 uri = /vpc-routes
21332024-12-13T23:03:59.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41442 req_id = 30d37832-a059-40d2-9340-b1e4f603d758 response_code = 200 uri = /network-bootstore-config
21342024-12-13T23:03:59.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
21352024-12-13T23:03:59.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41053 req_id = 0de78bbf-4f0f-44e1-901a-2cb2772d99af response_code = 204 uri = /eip-gateways
21362024-12-13T23:03:59.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41053 req_id = 0f9967c0-e193-4d49-adca-1d15fddaef1e response_code = 204 uri = /vpc-routes
21372024-12-13T23:03:59.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49894
21382024-12-13T23:03:59.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49894 req_id = cdb41659-3123-404d-bd2a-bcf8e5b363d5 response_code = 200 uri = /v2p
21392024-12-13T23:03:59.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55645
21402024-12-13T23:03:59.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21412024-12-13T23:03:59.597ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21422024-12-13T23:03:59.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87190 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55645 req_id = a1343a54-1b56-42ff-95db-7f3b94799bf4 response_code = 204 uri = /switch-ports
21432024-12-13T23:03:59.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55645 req_id = eb103015-6fe7-42f9-9bf0-033a459c8fdf response_code = 200 uri = /network-bootstore-config
21442024-12-13T23:04:10.771ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7246 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 255a0c29-6f8d-4a64-8bb8-accd0997cd34 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
21452024-12-13T23:04:27.282ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56666
21462024-12-13T23:04:27.282ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56666 req_id = 1fa0d5bd-856e-44dd-8379-1552186c7cd9 response_code = 200 uri = /baseboard
21472024-12-13T23:04:29.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36031
21482024-12-13T23:04:29.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36031 req_id = f533bced-7408-47c5-a720-373f0330c8b9 response_code = 200 uri = /vpc-routes
21492024-12-13T23:04:29.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48130
21502024-12-13T23:04:29.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48130 req_id = 1dab52d6-e22d-4f36-9ac3-d5dc5c46393d response_code = 200 uri = /v2p
21512024-12-13T23:04:29.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41457
21522024-12-13T23:04:29.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41457 req_id = 6e86572a-fe43-4118-880b-17772672f676 response_code = 200 uri = /vpc-routes
21532024-12-13T23:04:29.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
21542024-12-13T23:04:29.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41457 req_id = b3714077-8970-4f43-825d-108abdcf70f1 response_code = 204 uri = /eip-gateways
21552024-12-13T23:04:29.298ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
21562024-12-13T23:04:29.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36031 req_id = 973d61c3-0f74-45c2-be01-f7b047f33930 response_code = 204 uri = /eip-gateways
21572024-12-13T23:04:29.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41457 req_id = 35696ca9-7b9e-448f-a64a-4df77d22f937 response_code = 204 uri = /vpc-routes
21582024-12-13T23:04:29.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36031 req_id = 79b4e086-040a-4739-819d-9f090b5c0d26 response_code = 204 uri = /vpc-routes
21592024-12-13T23:04:29.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51113
21602024-12-13T23:04:29.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21612024-12-13T23:04:29.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21622024-12-13T23:04:29.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106260 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51113 req_id = a1c1c321-3c0c-4d95-9c91-c5af04ac5a41 response_code = 204 uri = /switch-ports
21632024-12-13T23:04:29.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43055
21642024-12-13T23:04:29.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61776
21652024-12-13T23:04:29.433ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21662024-12-13T23:04:29.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3567 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61776 req_id = 10765526-5dd7-442a-8a03-88b71b6914cb response_code = 200 uri = /v2p
21672024-12-13T23:04:29.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3734 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51113 req_id = 37bb3c49-0cfd-4f6f-95a9-50aeda9bb1db response_code = 200 uri = /network-bootstore-config
21682024-12-13T23:04:29.470ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21692024-12-13T23:04:29.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43055 req_id = a929be6f-cdbe-4e45-a4f4-2c7ac2b9248c response_code = 204 uri = /switch-ports
21702024-12-13T23:04:29.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43055 req_id = 273a0cb9-6d3f-44db-a231-9426e9a0c105 response_code = 200 uri = /network-bootstore-config
21712024-12-13T23:04:29.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49482
21722024-12-13T23:04:29.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49482 req_id = 65798d75-7378-4334-a666-a8bfd7e912f9 response_code = 200 uri = /v2p
21732024-12-13T23:04:29.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38835
21742024-12-13T23:04:29.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38835 req_id = aff1acee-bcab-4265-a2b5-8a61c64baad1 response_code = 200 uri = /vpc-routes
21752024-12-13T23:04:29.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
21762024-12-13T23:04:29.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38835 req_id = 509740d8-d5bd-46a5-b787-3642eba9dbd4 response_code = 204 uri = /eip-gateways
21772024-12-13T23:04:29.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38835 req_id = fc2913fa-9c91-40bf-8cc5-7222c760560d response_code = 204 uri = /vpc-routes
21782024-12-13T23:04:29.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61336
21792024-12-13T23:04:29.765ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21802024-12-13T23:04:29.805ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21812024-12-13T23:04:29.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61336 req_id = bdb5cc8b-2536-4a38-b212-b31d5b29b3c4 response_code = 204 uri = /switch-ports
21822024-12-13T23:04:29.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61336 req_id = 701d31ff-fc69-425b-bc79-809908512c28 response_code = 200 uri = /network-bootstore-config
21832024-12-13T23:04:40.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7859 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = a76e0941-45c5-4e5a-b95e-7c12b4b74b7b response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
21842024-12-13T23:04:57.314ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56434
21852024-12-13T23:04:57.314ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56434 req_id = 5588f04d-44c3-4858-ace8-8a740adc8acb response_code = 200 uri = /baseboard
21862024-12-13T23:04:59.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65163
21872024-12-13T23:04:59.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65163 req_id = 15ef2b8b-1de9-4be1-a085-a6c0c987e65b response_code = 200 uri = /vpc-routes
21882024-12-13T23:04:59.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
21892024-12-13T23:04:59.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65163 req_id = 393c342b-c961-4e3c-9599-a95a49a11578 response_code = 204 uri = /eip-gateways
21902024-12-13T23:04:59.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37555
21912024-12-13T23:04:59.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37555 req_id = ce5b5c27-18d6-4605-a80f-1f407b41d6e2 response_code = 200 uri = /vpc-routes
21922024-12-13T23:04:59.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65163 req_id = 24c4be18-4d62-436f-9c69-e12e6df3d713 response_code = 204 uri = /vpc-routes
21932024-12-13T23:04:59.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
21942024-12-13T23:04:59.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37555 req_id = 3b0dc22e-5c28-4443-89a2-770dcf0bea68 response_code = 204 uri = /eip-gateways
21952024-12-13T23:04:59.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57977
21962024-12-13T23:04:59.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57977 req_id = fd86fb94-8f53-48a3-80d9-2d47078f3463 response_code = 200 uri = /v2p
21972024-12-13T23:04:59.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51832
21982024-12-13T23:04:59.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51832 req_id = cf527bcc-0ddd-446b-ba9b-5b84e2553cdb response_code = 200 uri = /v2p
21992024-12-13T23:04:59.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37555 req_id = 5500e38c-c030-4450-a320-2214dc3a1e52 response_code = 204 uri = /vpc-routes
22002024-12-13T23:04:59.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37969
22012024-12-13T23:04:59.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22022024-12-13T23:04:59.398ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22032024-12-13T23:04:59.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98249 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37969 req_id = 113697cc-8c00-44f2-a621-724b79babcc3 response_code = 204 uri = /switch-ports
22042024-12-13T23:04:59.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43997
22052024-12-13T23:04:59.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61401
22062024-12-13T23:04:59.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37969 req_id = f134388f-7b4f-44fc-b94d-c5ff147a835b response_code = 200 uri = /network-bootstore-config
22072024-12-13T23:04:59.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22082024-12-13T23:04:59.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61401 req_id = d03e03da-bb12-4258-a326-4035f71f3670 response_code = 200 uri = /vpc-routes
22092024-12-13T23:04:59.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22102024-12-13T23:04:59.510ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
22112024-12-13T23:04:59.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61401 req_id = 6ac5c3e8-fc90-4292-8cf6-d82b65a852e6 response_code = 204 uri = /eip-gateways
22122024-12-13T23:04:59.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51628
22132024-12-13T23:04:59.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51628 req_id = 5ad6349a-d931-4515-a0a5-48934ab8f0f6 response_code = 200 uri = /v2p
22142024-12-13T23:04:59.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61401 req_id = b4fba36f-662b-455a-836c-af628d84bc3d response_code = 204 uri = /vpc-routes
22152024-12-13T23:04:59.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104518 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43997 req_id = ea47bd2b-5d78-452c-82ae-7e54f50e1296 response_code = 204 uri = /switch-ports
22162024-12-13T23:04:59.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43997 req_id = 9f63f7b1-c18e-4ff2-86e2-73090392dba9 response_code = 200 uri = /network-bootstore-config
22172024-12-13T23:04:59.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48111
22182024-12-13T23:04:59.689ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22192024-12-13T23:04:59.725ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22202024-12-13T23:04:59.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91050 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48111 req_id = a12a1beb-369b-404e-851e-a95940fda711 response_code = 204 uri = /switch-ports
22212024-12-13T23:04:59.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48111 req_id = ab244d2a-57ac-4941-8d83-3179c9c681fa response_code = 200 uri = /network-bootstore-config
22222024-12-13T23:05:10.770ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6792 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = a81ea2a9-cef9-4bfe-917d-dc19cc115356 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
22232024-12-13T23:05:27.347ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54902
22242024-12-13T23:05:27.348ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54902 req_id = 2e96a9b9-d71f-4c27-872a-e3ecbc53a37a response_code = 200 uri = /baseboard
22252024-12-13T23:05:29.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43697
22262024-12-13T23:05:29.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43697 req_id = f6ed345f-1a8f-4d4d-a13c-edac1594c4c7 response_code = 200 uri = /vpc-routes
22272024-12-13T23:05:29.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34376
22282024-12-13T23:05:29.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34376 req_id = 078487c3-6522-4a56-b5fc-6a57fb566fd9 response_code = 200 uri = /v2p
22292024-12-13T23:05:29.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34908
22302024-12-13T23:05:29.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34908 req_id = 268e3c6d-cb74-4439-b654-412348ac3b1d response_code = 200 uri = /vpc-routes
22312024-12-13T23:05:29.290ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
22322024-12-13T23:05:29.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34908 req_id = 0f3d2ecb-be36-43b6-a853-1dd73b4d4eba response_code = 204 uri = /eip-gateways
22332024-12-13T23:05:29.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34908 req_id = 6e221769-242d-46e6-812a-d7b1da885232 response_code = 204 uri = /vpc-routes
22342024-12-13T23:05:29.327ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
22352024-12-13T23:05:29.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43697 req_id = 47e18ea3-ca37-41be-99a3-35390354f256 response_code = 204 uri = /eip-gateways
22362024-12-13T23:05:29.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43697 req_id = 1e881322-31c3-4033-8c98-aeb8b267936f response_code = 204 uri = /vpc-routes
22372024-12-13T23:05:29.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63886
22382024-12-13T23:05:29.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63886 req_id = 3a079c5a-c0d1-4505-8ea6-d8409bdbb89f response_code = 200 uri = /v2p
22392024-12-13T23:05:29.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55329
22402024-12-13T23:05:29.468ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22412024-12-13T23:05:29.508ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22422024-12-13T23:05:29.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55329 req_id = bccea695-a2d6-4fcc-93d0-456f97af185c response_code = 204 uri = /switch-ports
22432024-12-13T23:05:29.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60544
22442024-12-13T23:05:29.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53234
22452024-12-13T23:05:29.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55329 req_id = 3d8035ae-2129-4f8f-8d75-eede6b3eb402 response_code = 200 uri = /network-bootstore-config
22462024-12-13T23:05:29.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32948
22472024-12-13T23:05:29.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61633
22482024-12-13T23:05:29.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32948 req_id = 03d58497-d739-4dd0-b92b-175578b3f580 response_code = 200 uri = /vpc-routes
22492024-12-13T23:05:29.569ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22502024-12-13T23:05:29.569ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22512024-12-13T23:05:29.569ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22522024-12-13T23:05:29.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22532024-12-13T23:05:29.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22542024-12-13T23:05:29.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22552024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22562024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22572024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22582024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22592024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22602024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22612024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22622024-12-13T23:05:29.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5551 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60544 req_id = 7f14d7ab-b2ea-4881-8f6e-1bf715cdc6df response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22632024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22642024-12-13T23:05:29.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22652024-12-13T23:05:29.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5696 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53234 req_id = 9978f352-ff6e-4d26-a3fc-5e0386710368 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22662024-12-13T23:05:29.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57413
22672024-12-13T23:05:29.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57413 req_id = ff3cc79b-a55e-4453-9af4-df1e020ef9df response_code = 200 uri = /v2p
22682024-12-13T23:05:29.597ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
22692024-12-13T23:05:29.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32948 req_id = 611ba620-ae2b-42a1-b498-b2747adbbb9e response_code = 204 uri = /eip-gateways
22702024-12-13T23:05:29.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 591 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32948 req_id = 97d9b2fc-a87a-49f1-b3fb-211f47304d6c response_code = 204 uri = /vpc-routes
22712024-12-13T23:05:29.613ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22722024-12-13T23:05:29.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105482 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61633 req_id = 68c85f70-e4a8-46d0-9ee1-956598030753 response_code = 204 uri = /switch-ports
22732024-12-13T23:05:29.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61633 req_id = 53da8e5a-9d04-495b-8426-aaab7c80c0a4 response_code = 200 uri = /network-bootstore-config
22742024-12-13T23:05:29.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41840
22752024-12-13T23:05:29.709ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22762024-12-13T23:05:29.747ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22772024-12-13T23:05:29.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41840 req_id = 528c778e-fcb5-4be2-95eb-bed5e016ef68 response_code = 204 uri = /switch-ports
22782024-12-13T23:05:29.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63863
22792024-12-13T23:05:29.804ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22802024-12-13T23:05:29.804ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22812024-12-13T23:05:29.804ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22822024-12-13T23:05:29.804ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22832024-12-13T23:05:29.804ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22842024-12-13T23:05:29.804ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22852024-12-13T23:05:29.804ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22862024-12-13T23:05:29.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63863 req_id = 0d0f5f57-e348-42eb-b350-1f41d58efd2c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22872024-12-13T23:05:29.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41840 req_id = e67847d1-c43f-4d96-9579-1a882d11dc5e response_code = 200 uri = /network-bootstore-config
22882024-12-13T23:05:40.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7923 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 982488b7-0706-42a3-8243-91851b8f9886 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
22892024-12-13T23:05:57.381ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34583
22902024-12-13T23:05:57.381ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34583 req_id = 36ab0c64-b1bd-43bf-8ece-2cd7760debc8 response_code = 200 uri = /baseboard
22912024-12-13T23:05:59.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41719
22922024-12-13T23:05:59.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41719 req_id = 10bf30bc-5ad5-40f9-8738-cacf7e218511 response_code = 200 uri = /vpc-routes
22932024-12-13T23:05:59.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39569
22942024-12-13T23:05:59.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39569 req_id = 8bba5284-6299-4666-aded-d855d796f30f response_code = 200 uri = /v2p
22952024-12-13T23:05:59.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
22962024-12-13T23:05:59.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41719 req_id = a56e94ce-c3d1-4372-892e-99ad0ffa6668 response_code = 204 uri = /eip-gateways
22972024-12-13T23:05:59.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41719 req_id = d2b5b3ba-4384-43cb-a9f8-256cdce066c7 response_code = 204 uri = /vpc-routes
22982024-12-13T23:05:59.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40193
22992024-12-13T23:05:59.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40193 req_id = 384de1ab-dc3e-4f79-b44d-8ad923610908 response_code = 200 uri = /vpc-routes
23002024-12-13T23:05:59.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
23012024-12-13T23:05:59.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40193 req_id = fa65ba95-dd36-4373-8dc1-6ceefbd32f21 response_code = 204 uri = /eip-gateways
23022024-12-13T23:05:59.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40193 req_id = 3dc14535-670d-4e5f-b066-5ecc252841de response_code = 204 uri = /vpc-routes
23032024-12-13T23:05:59.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57135
23042024-12-13T23:05:59.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57135 req_id = b5a5b36f-3f9a-4f16-8aac-23297c04464f response_code = 200 uri = /v2p
23052024-12-13T23:05:59.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35804
23062024-12-13T23:05:59.219ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23072024-12-13T23:05:59.271ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23082024-12-13T23:05:59.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35804 req_id = a082c880-b94d-4dfd-8385-67b3a4962cc5 response_code = 204 uri = /switch-ports
23092024-12-13T23:05:59.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39418
23102024-12-13T23:05:59.335ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23112024-12-13T23:05:59.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35804 req_id = 0011c25c-d3e7-4f26-b02b-032cfd17f314 response_code = 200 uri = /network-bootstore-config
23122024-12-13T23:05:59.372ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23132024-12-13T23:05:59.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46851
23142024-12-13T23:05:59.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46851 req_id = 74b3e55e-477a-4415-ad38-071d2f0c8d25 response_code = 200 uri = /vpc-routes
23152024-12-13T23:05:59.430ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
23162024-12-13T23:05:59.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46851 req_id = d3ed6048-7927-4888-839a-9bb4f7991e47 response_code = 204 uri = /eip-gateways
23172024-12-13T23:05:59.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96197 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39418 req_id = 76ffdafa-eb6b-458d-bd45-624cd32fbbb2 response_code = 204 uri = /switch-ports
23182024-12-13T23:05:59.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39418 req_id = 1d6597ac-2458-4056-98f4-85b28660a823 response_code = 200 uri = /network-bootstore-config
23192024-12-13T23:05:59.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46851 req_id = 63886200-40ef-4a05-8ccb-6fccdf74b056 response_code = 204 uri = /vpc-routes
23202024-12-13T23:05:59.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46712
23212024-12-13T23:05:59.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46712 req_id = 85ae354a-6a63-4f85-9f32-4147be720141 response_code = 200 uri = /v2p
23222024-12-13T23:05:59.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56257
23232024-12-13T23:05:59.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23242024-12-13T23:05:59.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23252024-12-13T23:05:59.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56257 req_id = a73d5364-8d22-4325-adce-e2347a21c2ab response_code = 204 uri = /switch-ports
23262024-12-13T23:05:59.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56257 req_id = de1b64fd-9eb5-4e24-8694-6078716ef978 response_code = 200 uri = /network-bootstore-config
23272024-12-13T23:06:10.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7699 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 01848227-1d98-4535-8a97-03ad1efd0978 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
23282024-12-13T23:06:27.415ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63764
23292024-12-13T23:06:27.415ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63764 req_id = e95e5245-ab70-4c4c-bfc6-cf178f346f20 response_code = 200 uri = /baseboard
23302024-12-13T23:06:29.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56351
23312024-12-13T23:06:29.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56351 req_id = 96dcfb96-45f3-417f-8b1c-b3fff63dd291 response_code = 200 uri = /vpc-routes
23322024-12-13T23:06:29.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
23332024-12-13T23:06:29.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56351 req_id = 1cde1db5-a42e-4969-b63d-2e7549d7bcd8 response_code = 204 uri = /eip-gateways
23342024-12-13T23:06:29.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56351 req_id = a01a66ea-176c-4c8c-aa5a-9e8457bbc1ec response_code = 204 uri = /vpc-routes
23352024-12-13T23:06:29.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64205
23362024-12-13T23:06:29.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64205 req_id = 98707b27-ef9c-4e17-b8c8-4c1758a84fc0 response_code = 200 uri = /v2p
23372024-12-13T23:06:29.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36053
23382024-12-13T23:06:29.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36053 req_id = 44b0b7e0-f696-4a9e-806e-e79130e1635e response_code = 200 uri = /vpc-routes
23392024-12-13T23:06:29.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39936
23402024-12-13T23:06:29.449ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23412024-12-13T23:06:29.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23422024-12-13T23:06:29.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39936 req_id = 383a28d0-7569-4736-a985-ccf9ce688299 response_code = 204 uri = /switch-ports
23432024-12-13T23:06:29.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63694
23442024-12-13T23:06:29.573ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
23452024-12-13T23:06:29.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36053 req_id = f1a8b4f1-0e9d-42ae-becc-95366aa35864 response_code = 204 uri = /eip-gateways
23462024-12-13T23:06:29.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45853
23472024-12-13T23:06:29.574ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23482024-12-13T23:06:29.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39936 req_id = 2bd9b38c-86e7-4c6b-8e65-065bae51c162 response_code = 200 uri = /network-bootstore-config
23492024-12-13T23:06:29.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63694 req_id = 3763f5e6-a5ee-4685-a3b7-a6fc77f7d82a response_code = 200 uri = /vpc-routes
23502024-12-13T23:06:29.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36053 req_id = fb1e1031-1793-4000-b981-7f9efeb5d0ba response_code = 204 uri = /vpc-routes
23512024-12-13T23:06:29.593ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
23522024-12-13T23:06:29.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63694 req_id = 9f42d2d4-5b61-4faa-9b05-69043d8ce025 response_code = 204 uri = /eip-gateways
23532024-12-13T23:06:29.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63694 req_id = 63dae170-73eb-4fe6-836f-09daca8a6af7 response_code = 204 uri = /vpc-routes
23542024-12-13T23:06:29.618ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23552024-12-13T23:06:29.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63091
23562024-12-13T23:06:29.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63091 req_id = b60beba9-6c15-4606-9975-6e1464174323 response_code = 200 uri = /v2p
23572024-12-13T23:06:29.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102625 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45853 req_id = 366e7b95-67d0-48f0-a40a-acb01c56b063 response_code = 204 uri = /switch-ports
23582024-12-13T23:06:29.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45853 req_id = af41ebe6-1d28-468f-95ec-5fd536905333 response_code = 200 uri = /network-bootstore-config
23592024-12-13T23:06:29.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41499
23602024-12-13T23:06:29.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41499 req_id = 35b1b3b0-3003-4d33-a333-aac29035aa09 response_code = 200 uri = /v2p
23612024-12-13T23:06:29.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49217
23622024-12-13T23:06:29.740ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23632024-12-13T23:06:29.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23642024-12-13T23:06:29.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96388 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49217 req_id = 3bf78730-5469-4ae3-a82b-5beac023507c response_code = 204 uri = /switch-ports
23652024-12-13T23:06:29.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49217 req_id = 0609dbba-dcab-4020-87ce-813ffda3bb4a response_code = 200 uri = /network-bootstore-config
23662024-12-13T23:06:40.771ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6826 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 97d580d8-3dac-4048-90e9-b53bc1d0726b response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
23672024-12-13T23:06:57.449ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55937
23682024-12-13T23:06:57.449ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55937 req_id = a5cc04b9-0db8-4358-a1a5-5689e8f9f3d3 response_code = 200 uri = /baseboard
23692024-12-13T23:06:59.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64289
23702024-12-13T23:06:59.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64289 req_id = c33e81c6-5899-46f2-84ac-ee088ff887ca response_code = 200 uri = /vpc-routes
23712024-12-13T23:06:59.135ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
23722024-12-13T23:06:59.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64289 req_id = e66fda71-2dee-4831-9737-3934abbcfae1 response_code = 204 uri = /eip-gateways
23732024-12-13T23:06:59.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64289 req_id = 4e55c1e2-0d31-4bb2-b72e-25984df4ad08 response_code = 204 uri = /vpc-routes
23742024-12-13T23:06:59.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49316
23752024-12-13T23:06:59.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49316 req_id = 94522433-3272-47ca-8c13-227b2c90a27c response_code = 200 uri = /vpc-routes
23762024-12-13T23:06:59.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48933
23772024-12-13T23:06:59.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48933 req_id = e5474212-55d9-4910-a542-bdac2359cee2 response_code = 200 uri = /v2p
23782024-12-13T23:06:59.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41463
23792024-12-13T23:06:59.200ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23802024-12-13T23:06:59.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23812024-12-13T23:06:59.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41463 req_id = fde7b8c8-0c3a-45ff-a37d-4d9141a79c8b response_code = 204 uri = /switch-ports
23822024-12-13T23:06:59.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58296
23832024-12-13T23:06:59.332ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
23842024-12-13T23:06:59.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49316 req_id = e5db7c5f-e846-41f1-bc2f-790ffa5c094b response_code = 204 uri = /eip-gateways
23852024-12-13T23:06:59.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41463 req_id = 62dbf139-19ed-437e-a207-3701395e73eb response_code = 200 uri = /network-bootstore-config
23862024-12-13T23:06:59.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58296 req_id = de04386b-0e14-4adc-960c-c02c60c8be8e response_code = 200 uri = /v2p
23872024-12-13T23:06:59.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37065
23882024-12-13T23:06:59.344ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23892024-12-13T23:06:59.386ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23902024-12-13T23:06:59.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104220 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37065 req_id = dab903fc-5936-4494-bd1e-8f015cae3d9f response_code = 204 uri = /switch-ports
23912024-12-13T23:06:59.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36577
23922024-12-13T23:06:59.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61171
23932024-12-13T23:06:59.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37065 req_id = 6e181973-67f4-41ad-9d40-23ddac83f9bf response_code = 200 uri = /network-bootstore-config
23942024-12-13T23:06:59.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49316 req_id = f3496312-c02c-49c1-b74a-14e9667791c8 response_code = 204 uri = /vpc-routes
23952024-12-13T23:06:59.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36577 req_id = 2a5bf3e1-6689-4dc8-9e93-e03b46edb04a response_code = 200 uri = /vpc-routes
23962024-12-13T23:06:59.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61171 req_id = e3f1326f-f6d0-4d49-89c4-b3b6821abe9e response_code = 200 uri = /v2p
23972024-12-13T23:06:59.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35199
23982024-12-13T23:06:59.474ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23992024-12-13T23:06:59.512ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24002024-12-13T23:06:59.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35199 req_id = f770592d-daf7-4ec6-90c4-903884ad5d53 response_code = 204 uri = /switch-ports
24012024-12-13T23:06:59.570ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24022024-12-13T23:06:59.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36577 req_id = 4615e202-c8e1-41b6-92c6-9ed109fa5b44 response_code = 204 uri = /eip-gateways
24032024-12-13T23:06:59.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35199 req_id = cc900fde-9cb0-4d6b-822a-3e09fa518152 response_code = 200 uri = /network-bootstore-config
24042024-12-13T23:06:59.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 404 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36577 req_id = 80a06c58-367e-4ae1-8743-586925adcedc response_code = 204 uri = /vpc-routes
24052024-12-13T23:07:10.771ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6928 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 1579567b-6aa5-4ef7-99c9-3cc25ff90a1b response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
24062024-12-13T23:07:27.483ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60789
24072024-12-13T23:07:27.483ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60789 req_id = dba46e7c-4d45-4120-bf46-af642d3e472a response_code = 200 uri = /baseboard
24082024-12-13T23:07:29.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36233
24092024-12-13T23:07:29.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36233 req_id = 400b7e7a-4e2a-4c8a-96dc-16d0da682772 response_code = 200 uri = /vpc-routes
24102024-12-13T23:07:29.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24112024-12-13T23:07:29.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36233 req_id = 323e6632-f054-4802-9dea-d1cc36f493d6 response_code = 204 uri = /eip-gateways
24122024-12-13T23:07:29.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36233 req_id = 18f61ed4-7fa4-4680-bbd0-a9210f7367d8 response_code = 204 uri = /vpc-routes
24132024-12-13T23:07:29.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41855
24142024-12-13T23:07:29.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41855 req_id = b4a3894f-2b9d-47f8-9237-bee82c7f2137 response_code = 200 uri = /vpc-routes
24152024-12-13T23:07:29.306ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24162024-12-13T23:07:29.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41855 req_id = 9f63dfdf-bb32-4088-a60e-2ce408af5934 response_code = 204 uri = /eip-gateways
24172024-12-13T23:07:29.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41855 req_id = 02467054-5708-4c73-b635-ff17c707a3fd response_code = 204 uri = /vpc-routes
24182024-12-13T23:07:29.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54102
24192024-12-13T23:07:29.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54102 req_id = 21543529-406e-458b-82f2-bf95b10dfd3e response_code = 200 uri = /v2p
24202024-12-13T23:07:29.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50025
24212024-12-13T23:07:29.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50025 req_id = 446c837c-102a-44ac-a6ab-cf5d3b9d4882 response_code = 200 uri = /v2p
24222024-12-13T23:07:29.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48065
24232024-12-13T23:07:29.349ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24242024-12-13T23:07:29.388ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24252024-12-13T23:07:29.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93668 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48065 req_id = cb499dea-dade-46eb-9247-f6f9432a9f79 response_code = 204 uri = /switch-ports
24262024-12-13T23:07:29.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48065 req_id = b4c8ec3e-63d7-4edc-a717-8cc70651df75 response_code = 200 uri = /network-bootstore-config
24272024-12-13T23:07:29.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48734
24282024-12-13T23:07:29.447ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24292024-12-13T23:07:29.484ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24302024-12-13T23:07:29.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90472 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48734 req_id = e186847c-1d71-4a5d-a1b3-50d6b003150f response_code = 204 uri = /switch-ports
24312024-12-13T23:07:29.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37202
24322024-12-13T23:07:29.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37202 req_id = 653d3f1c-103c-48bb-a27a-5715f888af47 response_code = 200 uri = /vpc-routes
24332024-12-13T23:07:29.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48734 req_id = a16d0118-1fd4-48b5-81a7-aeb9330c85de response_code = 200 uri = /network-bootstore-config
24342024-12-13T23:07:29.582ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24352024-12-13T23:07:29.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37202 req_id = d9d00cd9-002e-4c33-b93c-c486001fcd1d response_code = 204 uri = /eip-gateways
24362024-12-13T23:07:29.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39674
24372024-12-13T23:07:29.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39674 req_id = ef0f339a-7233-4345-bd9b-460739fff4d9 response_code = 200 uri = /v2p
24382024-12-13T23:07:29.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37202 req_id = f6589ed1-5e97-4c4e-a226-c34da2a689a9 response_code = 204 uri = /vpc-routes
24392024-12-13T23:07:29.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38568
24402024-12-13T23:07:29.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24412024-12-13T23:07:29.755ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24422024-12-13T23:07:29.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90148 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38568 req_id = 0590417b-440f-48a4-bbd4-780bc59ce1dd response_code = 204 uri = /switch-ports
24432024-12-13T23:07:29.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38568 req_id = 06b72b19-3dfe-4544-ad11-59e17af7b8a9 response_code = 200 uri = /network-bootstore-config
24442024-12-13T23:07:40.771ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6868 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 1db3e214-42ec-44ec-9958-a2c0018026bf response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
24452024-12-13T23:07:57.515ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53607
24462024-12-13T23:07:57.515ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53607 req_id = 5af146d7-bf2d-4bb1-b8d7-b4ca859e399e response_code = 200 uri = /baseboard
24472024-12-13T23:07:59.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34324
24482024-12-13T23:07:59.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34324 req_id = 49b87b6d-ecbf-4a29-80e5-e87a9d81c78e response_code = 200 uri = /vpc-routes
24492024-12-13T23:07:59.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46863
24502024-12-13T23:07:59.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46863 req_id = 36521728-6150-49d5-a627-ee04558577f7 response_code = 200 uri = /vpc-routes
24512024-12-13T23:07:59.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54864
24522024-12-13T23:07:59.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54864 req_id = 01cf10cf-ae8a-4d32-ae5c-6f9273b16f5d response_code = 200 uri = /v2p
24532024-12-13T23:07:59.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24542024-12-13T23:07:59.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34324 req_id = 1691b6c5-a124-48a8-9a80-18be281cc04c response_code = 204 uri = /eip-gateways
24552024-12-13T23:07:59.105ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24562024-12-13T23:07:59.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46863 req_id = d0f7b293-24f6-41ed-a9f7-fb259646c164 response_code = 204 uri = /eip-gateways
24572024-12-13T23:07:59.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34324 req_id = 1245b876-6b01-4d26-8884-f079ac61d686 response_code = 204 uri = /vpc-routes
24582024-12-13T23:07:59.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46863 req_id = d12bcca4-abe4-433c-ba3d-c12c84d4316e response_code = 204 uri = /vpc-routes
24592024-12-13T23:07:59.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45556
24602024-12-13T23:07:59.149ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24612024-12-13T23:07:59.187ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24622024-12-13T23:07:59.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116773 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45556 req_id = e58b8e19-4bdb-49bd-ae63-9c188772e0a7 response_code = 204 uri = /switch-ports
24632024-12-13T23:07:59.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38156
24642024-12-13T23:07:59.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60991
24652024-12-13T23:07:59.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45556 req_id = 6b999f1d-88a1-46fd-9ce4-c32637c0f31e response_code = 200 uri = /network-bootstore-config
24662024-12-13T23:07:59.267ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24672024-12-13T23:07:59.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60991 req_id = ce427e65-1eda-4e1f-a950-1747e375597e response_code = 200 uri = /v2p
24682024-12-13T23:07:59.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24692024-12-13T23:07:59.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38156 req_id = a546db06-7865-4850-90d8-54dd0a29a669 response_code = 204 uri = /switch-ports
24702024-12-13T23:07:59.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38156 req_id = 0456b7f7-e442-4d84-85a4-97314e89403e response_code = 200 uri = /network-bootstore-config
24712024-12-13T23:07:59.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59999
24722024-12-13T23:07:59.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59999 req_id = 6459b839-3fee-4e68-98ab-6e2e08792775 response_code = 200 uri = /vpc-routes
24732024-12-13T23:07:59.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46653
24742024-12-13T23:07:59.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46653 req_id = 2561b7d6-78a6-47d7-bea3-c4f74f465a08 response_code = 200 uri = /v2p
24752024-12-13T23:07:59.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44128
24762024-12-13T23:07:59.556ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24772024-12-13T23:07:59.594ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24782024-12-13T23:07:59.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44128 req_id = adc5aa5c-2c64-49e3-bb2f-eb38e407deb1 response_code = 204 uri = /switch-ports
24792024-12-13T23:07:59.649ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24802024-12-13T23:07:59.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59999 req_id = 7d26bedb-5f1c-41b8-bb01-3e3c085bbf25 response_code = 204 uri = /eip-gateways
24812024-12-13T23:07:59.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44128 req_id = 9ca862e5-9db1-4a5c-989b-49bf5aad7661 response_code = 200 uri = /network-bootstore-config
24822024-12-13T23:07:59.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59999 req_id = 6dae5461-d180-4891-92c7-a54dc231717c response_code = 204 uri = /vpc-routes
24832024-12-13T23:08:06.573ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24842024-12-13T23:08:06.573ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
24852024-12-13T23:08:06.601ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1932, tv_nsec: 423976540 } time_to_next_cleanup = 599.99999644s
24862024-12-13T23:08:10.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8325 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = f42f59ed-d274-4be1-8bbd-415ca120ed22 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
24872024-12-13T23:08:20.462ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24882024-12-13T23:08:27.547ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65315
24892024-12-13T23:08:27.548ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65315 req_id = 42480493-b344-4598-8cf6-3a4d6993a2b7 response_code = 200 uri = /baseboard
24902024-12-13T23:08:29.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62406
24912024-12-13T23:08:29.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62406 req_id = 31aa7b24-bd83-45ef-a05c-7dcffbd2672c response_code = 200 uri = /vpc-routes
24922024-12-13T23:08:29.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61130
24932024-12-13T23:08:29.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61130 req_id = df5621e6-f934-49bf-a655-c54b23c234f6 response_code = 200 uri = /vpc-routes
24942024-12-13T23:08:29.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24952024-12-13T23:08:29.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62406 req_id = ffe6316d-9899-4feb-8663-a7ea73b02b4c response_code = 204 uri = /eip-gateways
24962024-12-13T23:08:29.289ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
24972024-12-13T23:08:29.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61130 req_id = 859742ea-95a5-48d2-b87a-97ca0f890799 response_code = 204 uri = /eip-gateways
24982024-12-13T23:08:29.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62406 req_id = 6549d29c-ce5e-4cb0-a8b6-874b9a1241bf response_code = 204 uri = /vpc-routes
24992024-12-13T23:08:29.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61130 req_id = 8e95425a-0ef1-4627-b7db-5504705fc54b response_code = 204 uri = /vpc-routes
25002024-12-13T23:08:29.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43686
25012024-12-13T23:08:29.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43686 req_id = 0572de00-88ef-4b1e-8717-afb30a1ba25b response_code = 200 uri = /v2p
25022024-12-13T23:08:29.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51028
25032024-12-13T23:08:29.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25042024-12-13T23:08:29.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25052024-12-13T23:08:29.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51028 req_id = feaf4090-62de-4ecc-bb6b-a564db8a900a response_code = 204 uri = /switch-ports
25062024-12-13T23:08:29.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52005
25072024-12-13T23:08:29.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52005 req_id = 26789547-b34d-4a66-8d9b-8481920a3ab4 response_code = 200 uri = /v2p
25082024-12-13T23:08:29.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51028 req_id = 21572b1a-6029-4cd9-9d53-ece295191f2b response_code = 200 uri = /network-bootstore-config
25092024-12-13T23:08:29.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53688
25102024-12-13T23:08:29.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53688 req_id = 3411ba7d-cf2b-4707-bc0a-9d4922605d61 response_code = 200 uri = /vpc-routes
25112024-12-13T23:08:29.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44515
25122024-12-13T23:08:29.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44515 req_id = 5938a1c3-62f1-496e-88ac-82186eeb331d response_code = 200 uri = /v2p
25132024-12-13T23:08:29.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39687
25142024-12-13T23:08:29.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25152024-12-13T23:08:29.638ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25162024-12-13T23:08:29.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39687 req_id = b80855ae-d395-4872-a0da-22539677af3b response_code = 204 uri = /switch-ports
25172024-12-13T23:08:29.688ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
25182024-12-13T23:08:29.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53688 req_id = 374aa20a-07a0-4e72-8cde-461d87c91342 response_code = 204 uri = /eip-gateways
25192024-12-13T23:08:29.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39687 req_id = ed29662c-f3e1-44b4-8594-ce050282c100 response_code = 200 uri = /network-bootstore-config
25202024-12-13T23:08:29.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53688 req_id = 76ea74c8-8528-412d-bb56-cc593faa0dd9 response_code = 204 uri = /vpc-routes
25212024-12-13T23:08:29.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58957
25222024-12-13T23:08:29.834ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25232024-12-13T23:08:29.870ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25242024-12-13T23:08:29.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89042 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58957 req_id = df62502d-263f-4606-b335-554fac697172 response_code = 204 uri = /switch-ports
25252024-12-13T23:08:29.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58957 req_id = a6822af1-c497-490e-bd97-9995043a9582 response_code = 200 uri = /network-bootstore-config
25262024-12-13T23:08:40.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8108 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 13cdcc79-7376-4f70-a97d-290104da4ad2 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
25272024-12-13T23:08:57.580ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32908
25282024-12-13T23:08:57.580ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32908 req_id = 1b83b91e-890a-4da0-acc8-1e42a3e027a0 response_code = 200 uri = /baseboard
25292024-12-13T23:08:58.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54980
25302024-12-13T23:08:58.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54980 req_id = c5946962-eefe-4728-ab83-98a1568c0adb response_code = 200 uri = /v2p
25312024-12-13T23:08:59.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46925
25322024-12-13T23:08:59.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46925 req_id = 0c3eefd6-974d-4659-9cd1-e43a4ff0b42f response_code = 200 uri = /vpc-routes
25332024-12-13T23:08:59.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
25342024-12-13T23:08:59.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46925 req_id = c5c7bfd8-71ce-4d9b-8ead-b27a08e68eec response_code = 204 uri = /eip-gateways
25352024-12-13T23:08:59.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46925 req_id = be6159b8-0a48-4d08-827a-e60d5b823ea2 response_code = 204 uri = /vpc-routes
25362024-12-13T23:08:59.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47654
25372024-12-13T23:08:59.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47654 req_id = 09505749-836c-40ab-aec6-095b53fdca15 response_code = 200 uri = /vpc-routes
25382024-12-13T23:08:59.139ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
25392024-12-13T23:08:59.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47654 req_id = b74a8d02-f1b9-40af-a9e5-654cf61461b4 response_code = 204 uri = /eip-gateways
25402024-12-13T23:08:59.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47654 req_id = 72eef3ce-2430-4ece-a83a-043496e9dd4a response_code = 204 uri = /vpc-routes
25412024-12-13T23:08:59.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34364
25422024-12-13T23:08:59.225ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25432024-12-13T23:08:59.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25442024-12-13T23:08:59.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118399 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34364 req_id = 6c6b8927-d575-49e2-9020-2925d87b8709 response_code = 204 uri = /switch-ports
25452024-12-13T23:08:59.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38263
25462024-12-13T23:08:59.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34364 req_id = 4ea847e6-5e07-4d54-b230-6965f3454381 response_code = 200 uri = /network-bootstore-config
25472024-12-13T23:08:59.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38263 req_id = 06317623-579c-4613-be68-01e59ba60ef3 response_code = 200 uri = /v2p
25482024-12-13T23:08:59.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36309
25492024-12-13T23:08:59.398ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25502024-12-13T23:08:59.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25512024-12-13T23:08:59.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36309 req_id = d064fea3-9c38-4d2b-9d72-734b6d13f0d9 response_code = 204 uri = /switch-ports
25522024-12-13T23:08:59.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61586
25532024-12-13T23:08:59.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61586 req_id = d8d40f78-d593-4d05-ac25-665e84145ce2 response_code = 200 uri = /vpc-routes
25542024-12-13T23:08:59.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36309 req_id = 006b0829-ffc6-4996-ab83-06a9cd066286 response_code = 200 uri = /network-bootstore-config
25552024-12-13T23:08:59.507ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
25562024-12-13T23:08:59.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61586 req_id = 3494b604-d3b9-4542-80c9-d32754d5f2e7 response_code = 204 uri = /eip-gateways
25572024-12-13T23:08:59.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32927
25582024-12-13T23:08:59.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32927 req_id = d2e22fdf-d88d-4863-82be-568e3138c47b response_code = 200 uri = /v2p
25592024-12-13T23:08:59.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61586 req_id = 45587ce7-f625-4f23-9fe8-65c7c22d2646 response_code = 204 uri = /vpc-routes
25602024-12-13T23:08:59.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41519
25612024-12-13T23:08:59.567ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25622024-12-13T23:08:59.601ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25632024-12-13T23:08:59.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88469 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41519 req_id = d678433e-f791-46bb-866a-270ca5b4043b response_code = 204 uri = /switch-ports
25642024-12-13T23:08:59.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41519 req_id = aad9382f-0c0b-4c43-8b58-d8851918c3a9 response_code = 200 uri = /network-bootstore-config
25652024-12-13T23:09:10.773ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8814 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 6e24f047-90cd-4ac4-b660-f73764791b00 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
25662024-12-13T23:09:27.613ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44673
25672024-12-13T23:09:27.613ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44673 req_id = f93afa66-3ecf-4987-a975-80d37c4aaaee response_code = 200 uri = /baseboard
25682024-12-13T23:09:29.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52896
25692024-12-13T23:09:29.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52896 req_id = d7755c5c-0d72-461d-a1c1-79bfb6c8960e response_code = 200 uri = /vpc-routes
25702024-12-13T23:09:29.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
25712024-12-13T23:09:29.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52896 req_id = 0b1b9f4e-a601-4567-9869-0eedc1db3ce2 response_code = 204 uri = /eip-gateways
25722024-12-13T23:09:29.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52896 req_id = e94c239b-bc1b-4705-ba33-e4fa96e75940 response_code = 204 uri = /vpc-routes
25732024-12-13T23:09:29.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47184
25742024-12-13T23:09:29.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47184 req_id = 8ad9365e-2d9f-4518-9ac2-1db2c6be889c response_code = 200 uri = /v2p
25752024-12-13T23:09:29.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40745
25762024-12-13T23:09:29.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40745 req_id = a2dadd77-b511-446f-85be-f9e7eb69090b response_code = 200 uri = /vpc-routes
25772024-12-13T23:09:29.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50612
25782024-12-13T23:09:29.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25792024-12-13T23:09:29.349ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25802024-12-13T23:09:29.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134021 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50612 req_id = a6c6d5af-e568-44a2-8cce-c497d3c13771 response_code = 204 uri = /switch-ports
25812024-12-13T23:09:29.423ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
25822024-12-13T23:09:29.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40745 req_id = 850f67ba-93e1-40a0-a7a5-40e5efd333d0 response_code = 204 uri = /eip-gateways
25832024-12-13T23:09:29.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50612 req_id = 3eb360f1-fd45-459d-b17c-9f6f42528371 response_code = 200 uri = /network-bootstore-config
25842024-12-13T23:09:29.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39454
25852024-12-13T23:09:29.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39454 req_id = c4338a09-29c6-4041-8ed5-477a22bffe44 response_code = 200 uri = /v2p
25862024-12-13T23:09:29.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40745 req_id = 6135667a-ced5-4853-8315-c63e340f6848 response_code = 204 uri = /vpc-routes
25872024-12-13T23:09:29.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40025
25882024-12-13T23:09:29.483ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25892024-12-13T23:09:29.519ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25902024-12-13T23:09:29.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90916 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40025 req_id = a0c1803f-835c-4783-8e5c-638369bd8c2c response_code = 204 uri = /switch-ports
25912024-12-13T23:09:29.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44537
25922024-12-13T23:09:29.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44537 req_id = 89a05306-559d-4ad3-a33b-83d5a39ff22b response_code = 200 uri = /vpc-routes
25932024-12-13T23:09:29.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40025 req_id = 75e21eec-7933-4d06-9f79-700a0efbb0c0 response_code = 200 uri = /network-bootstore-config
25942024-12-13T23:09:29.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63331
25952024-12-13T23:09:29.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63331 req_id = da0d8a3d-71f2-48b4-9481-8918994829c7 response_code = 200 uri = /v2p
25962024-12-13T23:09:29.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48118
25972024-12-13T23:09:29.777ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25982024-12-13T23:09:29.813ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25992024-12-13T23:09:29.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93686 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48118 req_id = c0e5950f-7933-4ef5-b776-003f3cd3e211 response_code = 204 uri = /switch-ports
26002024-12-13T23:09:29.870ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
26012024-12-13T23:09:29.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44537 req_id = 86969098-75a6-46b4-840f-441a2ac3d43f response_code = 204 uri = /eip-gateways
26022024-12-13T23:09:29.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48118 req_id = 9143f298-18ae-4667-83c8-8fa0034d41ce response_code = 200 uri = /network-bootstore-config
26032024-12-13T23:09:29.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44537 req_id = a1b4294c-a693-4a1e-8ed5-54f6f3618447 response_code = 204 uri = /vpc-routes
26042024-12-13T23:09:40.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7438 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = a4f8f755-3a61-4d14-8d7d-bbf8e8a82595 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
26052024-12-13T23:09:57.645ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52283
26062024-12-13T23:09:57.645ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52283 req_id = 171881c3-b8a9-4ed0-bd3c-5240364057c1 response_code = 200 uri = /baseboard
26072024-12-13T23:09:59.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41857
26082024-12-13T23:09:59.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41857 req_id = 6be774a0-e74b-4c2c-b6d5-ca4f2bded327 response_code = 200 uri = /vpc-routes
26092024-12-13T23:09:59.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
26102024-12-13T23:09:59.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41857 req_id = b897b361-b925-4eb0-a007-fa53edbb47ef response_code = 204 uri = /eip-gateways
26112024-12-13T23:09:59.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41857 req_id = 9c6805a6-b59b-451b-b499-671a9c6b3163 response_code = 204 uri = /vpc-routes
26122024-12-13T23:09:59.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55683
26132024-12-13T23:09:59.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55683 req_id = 88d24829-7f04-4996-8b27-8e925d10c883 response_code = 200 uri = /vpc-routes
26142024-12-13T23:09:59.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37848
26152024-12-13T23:09:59.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26162024-12-13T23:09:59.273ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26172024-12-13T23:09:59.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127253 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37848 req_id = 5f51c349-63d9-49ca-9632-e145640fe21d response_code = 204 uri = /switch-ports
26182024-12-13T23:09:59.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36357
26192024-12-13T23:09:59.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
26202024-12-13T23:09:59.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55683 req_id = 0821b488-1cd6-458c-8d14-1a5542703a18 response_code = 204 uri = /eip-gateways
26212024-12-13T23:09:59.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43289
26222024-12-13T23:09:59.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37848 req_id = 02f43fd8-3d6c-46d2-8931-9c8aa62a380e response_code = 200 uri = /network-bootstore-config
26232024-12-13T23:09:59.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36357 req_id = 3a70187c-a7f6-47aa-b0e7-668e7dbbc3b1 response_code = 200 uri = /v2p
26242024-12-13T23:09:59.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43289 req_id = f570f067-6e71-45cb-b7a4-17e726741699 response_code = 200 uri = /v2p
26252024-12-13T23:09:59.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55683 req_id = 3db483e9-6b7c-463b-8c08-f2f54bb6eeec response_code = 204 uri = /vpc-routes
26262024-12-13T23:09:59.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62034
26272024-12-13T23:09:59.363ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26282024-12-13T23:09:59.396ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26292024-12-13T23:09:59.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86065 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62034 req_id = 9f65c496-e8bd-4b1c-b37e-7dc5ad2b7a59 response_code = 204 uri = /switch-ports
26302024-12-13T23:09:59.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62034 req_id = 5930acaf-40e7-4d87-b328-dc734b7ef9d5 response_code = 200 uri = /network-bootstore-config
26312024-12-13T23:09:59.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55295
26322024-12-13T23:09:59.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55295 req_id = b80374c1-5fba-4bd3-a730-bb483e9041ac response_code = 200 uri = /vpc-routes
26332024-12-13T23:09:59.523ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
26342024-12-13T23:09:59.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55295 req_id = 63b08a21-d740-44a5-b0f3-043b383a11f5 response_code = 204 uri = /eip-gateways
26352024-12-13T23:09:59.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41259
26362024-12-13T23:09:59.532ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26372024-12-13T23:09:59.566ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26382024-12-13T23:09:59.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41259 req_id = 7ff3c877-63f0-42d9-814f-12d6406a39af response_code = 204 uri = /switch-ports
26392024-12-13T23:09:59.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53825
26402024-12-13T23:09:59.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55295 req_id = 78d2505a-7bad-495e-904e-fc427a36c0ad response_code = 204 uri = /vpc-routes
26412024-12-13T23:09:59.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41259 req_id = 9f5029d1-7f98-47bc-a431-4359a6d54231 response_code = 200 uri = /network-bootstore-config
26422024-12-13T23:09:59.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53825 req_id = 5fdb4283-4a9a-4dca-bdf6-06e62a70e445 response_code = 200 uri = /v2p
26432024-12-13T23:10:10.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7521 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 4836ff4a-27e6-4bb9-9d45-5e03e5ab8a8d response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
26442024-12-13T23:10:27.678ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56418
26452024-12-13T23:10:27.678ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56418 req_id = 57ed6f4f-b760-45ce-8752-3d9025d8bcdf response_code = 200 uri = /baseboard
26462024-12-13T23:10:29.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52027
26472024-12-13T23:10:29.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52027 req_id = 792a72bc-8c42-4a17-9008-cd8c86b4684e response_code = 200 uri = /vpc-routes
26482024-12-13T23:10:29.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37093
26492024-12-13T23:10:29.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37093 req_id = d6a09905-e56c-4c62-8542-0f9a6c808af0 response_code = 200 uri = /vpc-routes
26502024-12-13T23:10:29.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
26512024-12-13T23:10:29.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37093 req_id = f72a3239-6c38-4ad9-bdf8-b795be3a493f response_code = 204 uri = /eip-gateways
26522024-12-13T23:10:29.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37093 req_id = 54c26e65-9ab8-4e55-991a-dbf5afa89278 response_code = 204 uri = /vpc-routes
26532024-12-13T23:10:29.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58175
26542024-12-13T23:10:29.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58175 req_id = a8f791c4-20a5-48c9-b9c0-81d7be503c56 response_code = 200 uri = /v2p
26552024-12-13T23:10:29.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47320
26562024-12-13T23:10:29.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47320 req_id = 531c775e-5282-4f70-a067-80bb26b6c752 response_code = 200 uri = /v2p
26572024-12-13T23:10:29.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35861
26582024-12-13T23:10:29.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35861 req_id = e7d8260d-ed08-40f4-b79f-8d3b2eab21b9 response_code = 200 uri = /vpc-routes
26592024-12-13T23:10:29.573ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
26602024-12-13T23:10:29.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52027 req_id = 177b0f83-b6d9-49dc-8b05-34deea8c26b1 response_code = 204 uri = /eip-gateways
26612024-12-13T23:10:29.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47568
26622024-12-13T23:10:29.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
26632024-12-13T23:10:29.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
26642024-12-13T23:10:29.575ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:177
26652024-12-13T23:10:29.575ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:177
26662024-12-13T23:10:29.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37519
26672024-12-13T23:10:29.581ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26682024-12-13T23:10:29.593ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
26692024-12-13T23:10:29.593ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_f7cfdce7-5264-4421-96d5-85418ddb748d
26702024-12-13T23:10:29.627ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
26712024-12-13T23:10:29.627ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_cb54037f-125a-4af3-8595-b53b9b45d26a
26722024-12-13T23:10:29.634ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26732024-12-13T23:10:29.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42964
26742024-12-13T23:10:29.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
26752024-12-13T23:10:29.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 836 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35861 req_id = f150b409-b1a7-4bc9-a513-80bd4e020958 response_code = 204 uri = /eip-gateways
26762024-12-13T23:10:29.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52027 req_id = 6e1d3161-f3ea-4f1c-b8dd-84dca257e203 response_code = 204 uri = /vpc-routes
26772024-12-13T23:10:29.657ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
26782024-12-13T23:10:29.658ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_7ecf842b-e498-4351-b151-8dff95453908
26792024-12-13T23:10:29.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1092 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35861 req_id = b009ac2d-62a2-4597-96b1-42c0ffe31b28 response_code = 204 uri = /vpc-routes
26802024-12-13T23:10:29.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49206
26812024-12-13T23:10:29.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
26822024-12-13T23:10:29.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
26832024-12-13T23:10:29.676ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:177
26842024-12-13T23:10:29.677ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:177
26852024-12-13T23:10:29.689ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
26862024-12-13T23:10:29.689ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_27177673-3a08-4285-914d-2d0755afcc21
26872024-12-13T23:10:29.709ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
26882024-12-13T23:10:29.709ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_f7cfdce7-5264-4421-96d5-85418ddb748d
26892024-12-13T23:10:29.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38235
26902024-12-13T23:10:29.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37519 req_id = cb3375ea-95ea-46a9-ab17-092571a0307d response_code = 204 uri = /switch-ports
26912024-12-13T23:10:29.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37519 req_id = a8feb29a-46df-472e-ab8a-206cc474c9d3 response_code = 200 uri = /network-bootstore-config
26922024-12-13T23:10:29.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26932024-12-13T23:10:29.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
26942024-12-13T23:10:29.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
26952024-12-13T23:10:29.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61751
26962024-12-13T23:10:29.728ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/config/omicron-zones.json file = common/src/ledger.rs:177
26972024-12-13T23:10:29.731ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
26982024-12-13T23:10:29.732ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b
26992024-12-13T23:10:29.742ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27002024-12-13T23:10:29.742ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/12195489-dcbe-4d54-a310-73dc60950fee/config/omicron-zones.json file = common/src/ledger.rs:177
27012024-12-13T23:10:29.742ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27022024-12-13T23:10:29.742ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27032024-12-13T23:10:29.742ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27042024-12-13T23:10:29.742ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27052024-12-13T23:10:29.742ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27062024-12-13T23:10:29.742ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27072024-12-13T23:10:29.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9944 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61751 req_id = 55f9045d-fab6-440f-b6f0-64a7a990b7e4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27082024-12-13T23:10:29.749ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27092024-12-13T23:10:29.749ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_cb54037f-125a-4af3-8595-b53b9b45d26a
27102024-12-13T23:10:29.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57238
27112024-12-13T23:10:29.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57238 req_id = bac616ab-ccf8-4aeb-9083-18024d45d867 response_code = 200 uri = /v2p
27122024-12-13T23:10:29.765ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cfdce7-5264-4421-96d5-85418ddb748d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27132024-12-13T23:10:29.765ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_f7cfdce7-5264-4421-96d5-85418ddb748d
27142024-12-13T23:10:29.769ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27152024-12-13T23:10:29.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63036
27162024-12-13T23:10:29.791ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27172024-12-13T23:10:29.791ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_46df782d-5e10-4410-8b6c-9b413351c0ef
27182024-12-13T23:10:29.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27192024-12-13T23:10:29.808ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_7ecf842b-e498-4351-b151-8dff95453908
27202024-12-13T23:10:29.822ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27212024-12-13T23:10:29.822ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c
27222024-12-13T23:10:29.834ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb54037f-125a-4af3-8595-b53b9b45d26a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27232024-12-13T23:10:29.834ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_cb54037f-125a-4af3-8595-b53b9b45d26a
27242024-12-13T23:10:29.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27252024-12-13T23:10:29.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193509 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42964 req_id = a1c08665-e313-43e4-82de-6aee95b25f63 response_code = 204 uri = /switch-ports
27262024-12-13T23:10:29.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42964 req_id = c73cf461-a1b5-4f7d-b2b1-f96a1e460e70 response_code = 200 uri = /network-bootstore-config
27272024-12-13T23:10:29.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39145
27282024-12-13T23:10:29.850ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27292024-12-13T23:10:29.850ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_27177673-3a08-4285-914d-2d0755afcc21
27302024-12-13T23:10:29.864ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27312024-12-13T23:10:29.867ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27322024-12-13T23:10:29.867ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_66612a50-feea-47ce-a70f-e7d816b9348f
27332024-12-13T23:10:29.867ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27342024-12-13T23:10:29.875ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27352024-12-13T23:10:29.875ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27362024-12-13T23:10:29.875ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27372024-12-13T23:10:29.875ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27382024-12-13T23:10:29.876ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27392024-12-13T23:10:29.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39145 req_id = 352be296-d7e9-490c-ba66-49215f42eea9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27402024-12-13T23:10:29.881ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27412024-12-13T23:10:29.881ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b
27422024-12-13T23:10:29.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27432024-12-13T23:10:29.894ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ecf842b-e498-4351-b151-8dff95453908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27442024-12-13T23:10:29.894ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_7ecf842b-e498-4351-b151-8dff95453908
27452024-12-13T23:10:29.910ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27462024-12-13T23:10:29.910ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785
27472024-12-13T23:10:29.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27482024-12-13T23:10:29.927ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_46df782d-5e10-4410-8b6c-9b413351c0ef
27492024-12-13T23:10:29.941ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27177673-3a08-4285-914d-2d0755afcc21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27502024-12-13T23:10:29.941ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_27177673-3a08-4285-914d-2d0755afcc21
27512024-12-13T23:10:29.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 375258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47568 req_id = 731d76f7-58b5-47f6-81ba-addfe7ee895d response_code = 200 uri = /inventory
27522024-12-13T23:10:29.956ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27532024-12-13T23:10:29.956ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c
27542024-12-13T23:10:29.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63036 req_id = 04f614f9-3736-4e31-962d-23a4a0349f6a response_code = 204 uri = /switch-ports
27552024-12-13T23:10:29.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63036 req_id = b6163542-6907-4547-9d6a-058c2dc7910e response_code = 200 uri = /network-bootstore-config
27562024-12-13T23:10:29.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27572024-12-13T23:10:29.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_66612a50-feea-47ce-a70f-e7d816b9348f
27582024-12-13T23:10:29.993ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3372dce-79fa-4073-99f8-ad5d0145ad7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27592024-12-13T23:10:29.993ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_c3372dce-79fa-4073-99f8-ad5d0145ad7b
27602024-12-13T23:10:30.011ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27612024-12-13T23:10:30.011ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785
27622024-12-13T23:10:30.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61424
27632024-12-13T23:10:30.017ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bf0e9a66-67f9-4190-9e3b-b300fe55d3fb, kind: Service { id: 4c5c2ead-0193-4378-96e2-af2730e9ff43 }, name: Name("external-dns-4c5c2ead-0193-4378-96e2-af2730e9ff43"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce3591e2-d6c2-49e8-8185-83957805c324, kind: Service { id: 04a3334b-9752-441b-939b-8e2c1e79fc9b }, name: Name("external-dns-04a3334b-9752-441b-939b-8e2c1e79fc9b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 47d96e23-ef4e-4797-b8d6-00223b9b6bdc, kind: Service { id: fd3d6a74-47d0-4e20-8d4f-c289afdf1c32 }, name: Name("nexus-fd3d6a74-47d0-4e20-8d4f-c289afdf1c32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d11ba8f0-912a-45b6-86ef-8760a4ef993f, kind: Service { id: 3bcfc5b9-4c22-408c-a69d-b35ff40dc662 }, name: Name("nexus-3bcfc5b9-4c22-408c-a69d-b35ff40dc662"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: daf42164-435f-4ee2-9331-fddd43af507d, kind: Service { id: ede3dd84-e6a9-4e76-ba9d-d388d6664cb5 }, name: Name("nexus-ede3dd84-e6a9-4e76-ba9d-d388d6664cb5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27642024-12-13T23:10:30.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27652024-12-13T23:10:30.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27662024-12-13T23:10:30.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27672024-12-13T23:10:30.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27682024-12-13T23:10:30.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27692024-12-13T23:10:30.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27702024-12-13T23:10:30.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 670 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61424 req_id = b6024eb2-6549-4cc7-829c-a7d66f4f8e89 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27712024-12-13T23:10:30.025ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46df782d-5e10-4410-8b6c-9b413351c0ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27722024-12-13T23:10:30.025ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_46df782d-5e10-4410-8b6c-9b413351c0ef
27732024-12-13T23:10:30.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49206 req_id = 7b1b38b1-c4b9-4e4a-a11a-223a4cb30d47 response_code = 200 uri = /inventory
27742024-12-13T23:10:30.047ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d98a5ee-ca47-4831-9b5d-9e612973ba1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27752024-12-13T23:10:30.047ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_3d98a5ee-ca47-4831-9b5d-9e612973ba1c
27762024-12-13T23:10:30.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66612a50-feea-47ce-a70f-e7d816b9348f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27772024-12-13T23:10:30.069ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_66612a50-feea-47ce-a70f-e7d816b9348f
27782024-12-13T23:10:30.091ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250b1dc6-2f04-40c0-aa88-b25ceadf6785 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:606
27792024-12-13T23:10:30.091ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1117 request = datasets_list zpool = oxp_250b1dc6-2f04-40c0-aa88-b25ceadf6785
27802024-12-13T23:10:30.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383039 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38235 req_id = 1c885217-db02-4d7e-ae0c-9c08858c132d response_code = 200 uri = /inventory
27812024-12-13T23:10:40.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8120 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 3b00d16a-8ee4-434b-95c6-99e8f222620a response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
27822024-12-13T23:10:57.710ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64577
27832024-12-13T23:10:57.710ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64577 req_id = 5766bd53-8d0a-49fd-bdaf-e08cb7815ffb response_code = 200 uri = /baseboard
27842024-12-13T23:10:58.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65017
27852024-12-13T23:10:58.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65017 req_id = 1e2f9a30-c280-4b66-8c7a-886d78151e2f response_code = 200 uri = /vpc-routes
27862024-12-13T23:10:59.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
27872024-12-13T23:10:59.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65017 req_id = fae67e2f-2160-4a87-9702-d24a6b98eebd response_code = 204 uri = /eip-gateways
27882024-12-13T23:10:59.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65017 req_id = 5d98bbc9-5ce2-4e98-b4d1-4e8728a7fc3a response_code = 204 uri = /vpc-routes
27892024-12-13T23:10:59.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48075
27902024-12-13T23:10:59.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48075 req_id = f75548e0-a7bf-49a2-a482-d0cbf6bd09bd response_code = 200 uri = /vpc-routes
27912024-12-13T23:10:59.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
27922024-12-13T23:10:59.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48075 req_id = 6a9cdb6b-e76f-4166-a890-5523a442dcc5 response_code = 204 uri = /eip-gateways
27932024-12-13T23:10:59.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48075 req_id = 9df5443b-f392-45f6-8804-b7988be78ff8 response_code = 204 uri = /vpc-routes
27942024-12-13T23:10:59.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63918
27952024-12-13T23:10:59.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63918 req_id = 53e7bdce-1a89-45bc-8f4a-7207ee5fffc1 response_code = 200 uri = /v2p
27962024-12-13T23:10:59.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35838
27972024-12-13T23:10:59.236ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27982024-12-13T23:10:59.283ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27992024-12-13T23:10:59.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120613 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35838 req_id = 906e8a46-28ae-4051-95fc-9715ca51d287 response_code = 204 uri = /switch-ports
28002024-12-13T23:10:59.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54462
28012024-12-13T23:10:59.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59686
28022024-12-13T23:10:59.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35838 req_id = 51c93691-b839-4cfd-aea3-c41b5e9a386c response_code = 200 uri = /network-bootstore-config
28032024-12-13T23:10:59.357ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28042024-12-13T23:10:59.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59686 req_id = 06299e2d-5ee9-435e-aadf-3d21c1dea950 response_code = 200 uri = /v2p
28052024-12-13T23:10:59.393ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28062024-12-13T23:10:59.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54462 req_id = d05ec351-f9ca-49fe-9c5d-560f5ad04179 response_code = 204 uri = /switch-ports
28072024-12-13T23:10:59.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54462 req_id = 70d18937-2425-41d7-91f3-011cc5ea050d response_code = 200 uri = /network-bootstore-config
28082024-12-13T23:10:59.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55093
28092024-12-13T23:10:59.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55093 req_id = a3c2e793-5f7e-491d-83d6-5591149c4777 response_code = 200 uri = /vpc-routes
28102024-12-13T23:10:59.517ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
28112024-12-13T23:10:59.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55093 req_id = 18440f20-8762-41ed-a1ad-58f07ee5fffc response_code = 204 uri = /eip-gateways
28122024-12-13T23:10:59.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55093 req_id = a9ca9688-43ee-4c45-bee3-bad969d6941f response_code = 204 uri = /vpc-routes
28132024-12-13T23:10:59.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53485
28142024-12-13T23:10:59.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53485 req_id = 3f1c22ab-df87-4c69-baf4-80dc954351e8 response_code = 200 uri = /v2p
28152024-12-13T23:10:59.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51488
28162024-12-13T23:10:59.570ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28172024-12-13T23:10:59.607ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28182024-12-13T23:10:59.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51488 req_id = 57ddc9e6-59d2-427d-a4c2-204110d2a04d response_code = 204 uri = /switch-ports
28192024-12-13T23:10:59.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51488 req_id = 8d45c140-58d9-49ea-99c2-39762df60b0e response_code = 200 uri = /network-bootstore-config
28202024-12-13T23:11:10.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7272 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 45d14884-aa94-4e72-9155-7804cc0f732d response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f
28212024-12-13T23:11:17.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55933
28222024-12-13T23:11:17.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55933 req_id = 29dfc174-86cc-488b-a7b3-ebd78348607d response_code = 200 uri = /v2p
28232024-12-13T23:11:17.681ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(1745179) }
28242024-12-13T23:11:17.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55933 req_id = cacf6c76-59fb-444a-b6a1-cc5f7e0707f2 response_code = 204 uri = /v2p
28252024-12-13T23:11:17.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47086
28262024-12-13T23:11:17.815ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a81eb93a-cd42-4aee-adc7-8f74971391da, kind: Instance { id: 8c45f6db-24bf-4574-9e43-82ceccd2970d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1745179), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a81eb93a-cd42-4aee-adc7-8f74971391da, kind: Instance { id: 8c45f6db-24bf-4574-9e43-82ceccd2970d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1745179), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a81eb93a-cd42-4aee-adc7-8f74971391da, kind: Instance { id: 8c45f6db-24bf-4574-9e43-82ceccd2970d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1745179), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1745179))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a81eb93a-cd42-4aee-adc7-8f74971391da, kind: Instance { id: 8c45f6db-24bf-4574-9e43-82ceccd2970d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1745179), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-43ae33d5cc0", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 7d891744-03a7-4425-8eef-5a0008e16ffb, read_only_parent: Some(Volume { block_size: 512, id: cc1ac485-0a63-4aeb-bb51-a6c415dd4447, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: d9eb86b4-a3fa-4d60-8772-c4b667549908, key: Some("VwKLEX40UU21UGMNlDSVIamQvzobOd7J2z6R+Bo689A="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::13]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7d891744-03a7-4425-8eef-5a0008e16ffb, key: Some("FgCK2kXvlp/ibwByqCi0QfLgBign75p+cExlYZm/z8I="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19003", "[fd00:1122:3344:101::14]:19003", "[fd00:1122:3344:101::18]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-43ae33d5cc0" }] }), cloud_init_bytes: Some(..) } instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d metadata = InstanceMetadata { silo_id: c9d0cd1a-e126-4640-b06d-6baa00743039, project_id: acc18648-580e-4c70-b236-cfb0fa686ab5 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-13T23:11:17.809462262Z }
28272024-12-13T23:11:17.816ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d migration_id = None propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28282024-12-13T23:11:17.816ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d migration_id = None propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a81eb93a-cd42-4aee-adc7-8f74971391da, kind: Instance { id: 8c45f6db-24bf-4574-9e43-82ceccd2970d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1745179), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a81eb93a-cd42-4aee-adc7-8f74971391da, kind: Instance { id: 8c45f6db-24bf-4574-9e43-82ceccd2970d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1745179), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a81eb93a-cd42-4aee-adc7-8f74971391da, kind: Instance { id: 8c45f6db-24bf-4574-9e43-82ceccd2970d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1745179), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1745179))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a81eb93a-cd42-4aee-adc7-8f74971391da, kind: Instance { id: 8c45f6db-24bf-4574-9e43-82ceccd2970d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1745179), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-43ae33d5cc0", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 7d891744-03a7-4425-8eef-5a0008e16ffb, read_only_parent: Some(Volume { block_size: 512, id: cc1ac485-0a63-4aeb-bb51-a6c415dd4447, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: d9eb86b4-a3fa-4d60-8772-c4b667549908, key: Some("VwKLEX40UU21UGMNlDSVIamQvzobOd7J2z6R+Bo689A="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::13]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7d891744-03a7-4425-8eef-5a0008e16ffb, key: Some("FgCK2kXvlp/ibwByqCi0QfLgBign75p+cExlYZm/z8I="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19003", "[fd00:1122:3344:101::14]:19003", "[fd00:1122:3344:101::18]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-43ae33d5cc0" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-13T23:11:17.809462262Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28292024-12-13T23:11:17.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4526 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47086 req_id = 9f8ff8ab-d52a-4c28-a360-d10d2cc1e506 response_code = 200 uri = /vmms/b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28302024-12-13T23:11:17.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59333
28312024-12-13T23:11:17.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59333 req_id = 2f768d72-f034-4e1b-9641-4f76bc21b594 response_code = 200 uri = /vmms/b3d8d483-9eae-4a14-8e0d-bedb8a87de8f/state
28322024-12-13T23:11:17.926ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 1745179 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28332024-12-13T23:11:17.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
28342024-12-13T23:11:17.963ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f file = illumos-utils/src/zone.rs:325 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28352024-12-13T23:11:17.986ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f file = illumos-utils/src/zone.rs:363 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28362024-12-13T23:11:18.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40211
28372024-12-13T23:11:18.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40211 req_id = b7a8c464-cd21-4af9-97c5-e0cb6259828c response_code = 200 uri = /vpc-routes
28382024-12-13T23:11:18.044ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {a81eb93a-cd42-4aee-adc7-8f74971391da: {10.151.2.176: {577084e1-c07b-466c-98e4-2cb3be765ffc}, 10.151.2.175: {577084e1-c07b-466c-98e4-2cb3be765ffc}}} }
28392024-12-13T23:11:19.342ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28402024-12-13T23:11:19.343ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone file = illumos-utils/src/running_zone.rs:488 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28412024-12-13T23:11:19.556ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 38.446376ms file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28422024-12-13T23:11:19.605ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 60.273288ms file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28432024-12-13T23:11:19.681ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 101.472155ms file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28442024-12-13T23:11:19.799ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 292.73852ms file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28452024-12-13T23:11:20.104ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 562.772034ms file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28462024-12-13T23:11:20.684ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 645.543158ms file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28472024-12-13T23:11:21.341ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 1.235075606s file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28482024-12-13T23:11:22.589ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 541.688864ms file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28492024-12-13T23:11:23.140ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 532.922801ms file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28502024-12-13T23:11:23.685ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f") failed: Property not found. retry in 1.278956511s file = illumos-utils/src/svc.rs:36 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f zone = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28512024-12-13T23:11:24.994ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f file = sled-agent/src/instance.rs:1786 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28522024-12-13T23:11:25.003ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28532024-12-13T23:11:25.042ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28542024-12-13T23:11:25.183ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28552024-12-13T23:11:25.185ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
28562024-12-13T23:11:25.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7140761 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40211 req_id = d0416c9f-22b9-4718-b6a2-ec38280f8d09 response_code = 204 uri = /eip-gateways
28572024-12-13T23:11:25.185ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-13T23:11:25.185369995Z } file = sled-agent/src/instance.rs:780 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28582024-12-13T23:11:25.185ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-13T23:11:25.185369995Z } propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28592024-12-13T23:11:25.185ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-13T23:11:25.185369995Z }, migration_in: None, migration_out: None }
28602024-12-13T23:11:25.196ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-13T23:11:25.196693597Z } file = sled-agent/src/instance.rs:780 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28612024-12-13T23:11:25.196ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-13T23:11:25.196693597Z } propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
28622024-12-13T23:11:25.196ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-13T23:11:25.196693597Z }, migration_in: None, migration_out: None }
28632024-12-13T23:11:25.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40211 req_id = 7717ca3b-bdda-4f44-974c-ff1e8ae48826 response_code = 204 uri = /vpc-routes
28642024-12-13T23:11:27.743ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62887
28652024-12-13T23:11:27.743ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62887 req_id = 5f0e0f6b-8820-4e99-a70a-fa7f2c0b1d4c response_code = 200 uri = /baseboard
28662024-12-13T23:11:29.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40267
28672024-12-13T23:11:29.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40267 req_id = 1faccf4b-2d35-49fb-9720-f46dc4cae21d response_code = 200 uri = /vpc-routes
28682024-12-13T23:11:29.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46371
28692024-12-13T23:11:29.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46371 req_id = d884bf4c-c160-4802-9ae0-f5073a6d6882 response_code = 200 uri = /vmms/b3d8d483-9eae-4a14-8e0d-bedb8a87de8f/state
28702024-12-13T23:11:29.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52620
28712024-12-13T23:11:29.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52620 req_id = c96e3d37-ea38-4089-8878-c2e16c2953df response_code = 200 uri = /vmms/b3d8d483-9eae-4a14-8e0d-bedb8a87de8f/state
28722024-12-13T23:11:29.390ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {a81eb93a-cd42-4aee-adc7-8f74971391da: {10.151.2.176: {577084e1-c07b-466c-98e4-2cb3be765ffc}, 10.151.2.175: {577084e1-c07b-466c-98e4-2cb3be765ffc}}} }
28732024-12-13T23:11:29.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40267 req_id = 3fbf444e-d64e-4273-8e41-2790e59f72e3 response_code = 204 uri = /eip-gateways
28742024-12-13T23:11:29.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63376
28752024-12-13T23:11:29.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63376 req_id = 571652b3-ce4a-4178-af1a-668a8269ab5e response_code = 200 uri = /vmms/b3d8d483-9eae-4a14-8e0d-bedb8a87de8f/state
28762024-12-13T23:11:29.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 515 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40267 req_id = c42b9055-0e62-499e-aa33-6b1ebdfccbf6 response_code = 204 uri = /vpc-routes
28772024-12-13T23:11:29.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59069
28782024-12-13T23:11:29.469ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28792024-12-13T23:11:29.525ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28802024-12-13T23:11:29.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59069 req_id = 9c34690e-6870-41ea-b4fa-7a92a988e566 response_code = 204 uri = /switch-ports
28812024-12-13T23:11:29.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42462
28822024-12-13T23:11:29.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63498
28832024-12-13T23:11:29.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63498 req_id = 75a4bad1-727a-4123-956f-df18cb1fbcb9 response_code = 200 uri = /vpc-routes
28842024-12-13T23:11:29.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59069 req_id = cb9885de-e7f1-4a27-951d-f8906cb4620b response_code = 200 uri = /network-bootstore-config
28852024-12-13T23:11:29.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42462 req_id = 27db87b2-9192-4ee6-bf21-db6b099087ca response_code = 200 uri = /v2p
28862024-12-13T23:11:29.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57562
28872024-12-13T23:11:29.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57562 req_id = ed8b6662-6966-4c74-84e9-8388d84a43e2 response_code = 200 uri = /v2p
28882024-12-13T23:11:29.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35905
28892024-12-13T23:11:29.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28902024-12-13T23:11:29.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28912024-12-13T23:11:29.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35905 req_id = f59cbd90-617f-49cc-93fe-ff37c8ce0fa6 response_code = 204 uri = /switch-ports
28922024-12-13T23:11:29.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63125
28932024-12-13T23:11:29.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43131
28942024-12-13T23:11:29.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {a81eb93a-cd42-4aee-adc7-8f74971391da: {10.151.2.176: {577084e1-c07b-466c-98e4-2cb3be765ffc}, 10.151.2.175: {577084e1-c07b-466c-98e4-2cb3be765ffc}}} }
28952024-12-13T23:11:29.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63498 req_id = 68484b39-575a-4c58-b846-c126220970a5 response_code = 204 uri = /eip-gateways
28962024-12-13T23:11:29.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35905 req_id = 9f0fec61-b408-498c-bc75-a41af9962b0f response_code = 200 uri = /network-bootstore-config
28972024-12-13T23:11:29.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63125 req_id = 70ac7328-9c7b-43cf-abae-e2c0e1c21660 response_code = 200 uri = /vpc-routes
28982024-12-13T23:11:29.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43131 req_id = 8feef693-f79b-46a8-8a63-153ab1bd166a response_code = 200 uri = /v2p
28992024-12-13T23:11:29.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40327
29002024-12-13T23:11:29.775ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29012024-12-13T23:11:29.824ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29022024-12-13T23:11:29.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121348 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40327 req_id = f8c0e87d-cf13-4a5f-abb8-f493783c69ce response_code = 204 uri = /switch-ports
29032024-12-13T23:11:29.897ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {a81eb93a-cd42-4aee-adc7-8f74971391da: {10.151.2.176: {577084e1-c07b-466c-98e4-2cb3be765ffc}, 10.151.2.175: {577084e1-c07b-466c-98e4-2cb3be765ffc}}} }
29042024-12-13T23:11:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63125 req_id = 755ee508-b7a8-4545-a507-32220c15d520 response_code = 204 uri = /eip-gateways
29052024-12-13T23:11:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40327 req_id = fd6e1ff0-af1c-446d-8ef5-31df5d741ce9 response_code = 200 uri = /network-bootstore-config
29062024-12-13T23:11:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 509 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63498 req_id = 42297237-21cc-44f2-8b75-a6ddee37ac6f response_code = 204 uri = /vpc-routes
29072024-12-13T23:11:29.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63125 req_id = 100f6a23-41d1-43ef-8f17-93d9ff85d194 response_code = 204 uri = /vpc-routes
29082024-12-13T23:11:35.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38493
29092024-12-13T23:11:35.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38493 req_id = 4273196b-3d1a-41be-93ae-a55e82fda193 response_code = 200 uri = /vmms/b3d8d483-9eae-4a14-8e0d-bedb8a87de8f/state
29102024-12-13T23:11:35.612ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-13T23:11:35.612252726Z } file = sled-agent/src/instance.rs:780 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29112024-12-13T23:11:35.612ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-13T23:11:35.612252726Z } propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29122024-12-13T23:11:35.612ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-13T23:11:35.612252726Z }, migration_in: None, migration_out: None }
29132024-12-13T23:11:35.622ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-13T23:11:35.622138683Z } file = sled-agent/src/instance.rs:780 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29142024-12-13T23:11:35.622ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-13T23:11:35.622138683Z } propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29152024-12-13T23:11:35.622ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29162024-12-13T23:11:35.622ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
29172024-12-13T23:11:35.622ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 9670246566240252201 n_samples = 6 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
29182024-12-13T23:11:35.622ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:606
29192024-12-13T23:11:35.622ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/04278734-afb9-43d6-af45-7faeeb868ab0/debug/bundle/zone", "/pool/int/12195489-dcbe-4d54-a310-73dc60950fee/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/f7cfdce7-5264-4421-96d5-85418ddb748d/crypt/debug", "/pool/ext/cb54037f-125a-4af3-8595-b53b9b45d26a/crypt/debug", "/pool/ext/7ecf842b-e498-4351-b151-8dff95453908/crypt/debug", "/pool/ext/27177673-3a08-4285-914d-2d0755afcc21/crypt/debug", "/pool/ext/c3372dce-79fa-4073-99f8-ad5d0145ad7b/crypt/debug", "/pool/ext/46df782d-5e10-4410-8b6c-9b413351c0ef/crypt/debug", "/pool/ext/3d98a5ee-ca47-4831-9b5d-9e612973ba1c/crypt/debug", "/pool/ext/66612a50-feea-47ce-a70f-e7d816b9348f/crypt/debug", "/pool/ext/250b1dc6-2f04-40c0-aa88-b25ceadf6785/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29202024-12-13T23:11:35.622ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 2198559822483157983 n_samples = 6 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
29212024-12-13T23:11:36.250ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f", bundle_id: 20b7ac6a-f845-4773-afb0-01728dc94c41 }, time_created: 2024-12-13T23:11:35.624197380Z, version: 0, cause: TerminatedInstance }
29222024-12-13T23:11:36.250ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_b3d8d483-9eae-4a14-8e0d-bedb8a87de8f file = sled-agent/src/instance.rs:1032 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29232024-12-13T23:11:38.006ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29242024-12-13T23:11:38.025ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(1745179), kind: System }
29252024-12-13T23:11:38.025ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(1745179), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29262024-12-13T23:11:38.027ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-13T23:11:38.027846451Z }, migration_in: None, migration_out: None }
29272024-12-13T23:11:38.061ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-13T23:11:38.027846451Z }, migration_in: None, migration_out: None }
29282024-12-13T23:11:38.065ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 8c45f6db-24bf-4574-9e43-82ceccd2970d propolis_id = b3d8d483-9eae-4a14-8e0d-bedb8a87de8f
29292024-12-13T23:11:38.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52239
29302024-12-13T23:11:38.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52239 req_id = 60f75aec-1e31-4a44-903b-9cae8d87908a response_code = 200 uri = /vpc-routes
29312024-12-13T23:11:38.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {a81eb93a-cd42-4aee-adc7-8f74971391da: {10.151.2.175: {577084e1-c07b-466c-98e4-2cb3be765ffc}, 10.151.2.176: {577084e1-c07b-466c-98e4-2cb3be765ffc}}} }
29322024-12-13T23:11:38.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52239 req_id = 6facdc77-d33b-4c3b-84ae-f2bd9ba383f0 response_code = 204 uri = /eip-gateways
29332024-12-13T23:11:38.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52239 req_id = e4bfbd3a-3663-46ec-9620-c9b959c73a97 response_code = 204 uri = /vpc-routes
29342024-12-13T23:11:38.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38480
29352024-12-13T23:11:38.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38480 req_id = 7482ade9-3d2c-44e4-ba09-bc828284845f response_code = 200 uri = /v2p
29362024-12-13T23:11:38.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55244
29372024-12-13T23:11:38.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55244 req_id = 837a733d-2667-434f-962b-2fca9a3c895d response_code = 200 uri = /v2p
29382024-12-13T23:11:39.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45878
29392024-12-13T23:11:39.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45878 req_id = 6223c5b3-b356-46b5-9811-c74feabae12b response_code = 200 uri = /vpc-routes
29402024-12-13T23:11:39.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
29412024-12-13T23:11:39.029ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f
29422024-12-13T23:11:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45878 req_id = 3b91c241-e1b7-4c0d-be0d-d3ccc85da240 response_code = 204 uri = /eip-gateways
29432024-12-13T23:11:39.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45878 req_id = 96154aec-1938-4d69-a970-796282a241dc response_code = 204 uri = /vpc-routes
29442024-12-13T23:11:39.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43722
29452024-12-13T23:11:39.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43722 req_id = 7d97a4da-b59f-403a-baab-7c5883707f7e response_code = 200 uri = /vpc-routes
29462024-12-13T23:11:39.662ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f values = ExternalIpGatewayMap { mappings: {} }
29472024-12-13T23:11:39.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43722 req_id = 3c3ffff0-c1fe-4933-8636-ebfb149ea69c response_code = 204 uri = /eip-gateways
29482024-12-13T23:11:39.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43722 req_id = ce0d998e-0728-4b48-8dff-02e83c70942e response_code = 204 uri = /vpc-routes
29492024-12-13T23:11:40.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7757 local_addr = [fd00:1122:3344:101::1]:46200 method = GET remote_addr = [fd00:1122:3344:101::d]:60974 req_id = 3dd65e9a-f1cf-47ca-84a2-b5251d1835d0 response_code = 200 sled_id = c991c27b-85ad-498c-8a93-464bd3ce406f uri = /c991c27b-85ad-498c-8a93-464bd3ce406f