Max level shown:
1 [ Nov 14 00:14:28 Enabled. ]
2 [ Nov 14 00:14:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 14 00:14:28 Method "start" exited with status 0. ]
4 [ Nov 14 00:14:28 Rereading configuration. ]
5 [ Nov 14 00:14:28 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-14T00:14:28.756ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-14T00:14:28.756ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-14T00:14:28.807ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-14T00:14:28.807ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-14T00:14:28.921ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-14T00:14:28.930ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-14T00:14:28.938ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-14T00:14:29.537ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-14T00:14:29.674ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-14T00:14:29.674ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-14T00:14:29.675ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-14T00:14:29.675ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-14T00:14:29.675ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-14T00:14:29.675ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-14T00:14:29.678ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-14T00:14:29.678ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-14T00:14:29.678ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-14T00:14:29.678ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-14T00:14:29.678ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-14T00:14:29.678ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-14T00:14:29.678ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-14T00:14:29.678ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-14T00:14:29.678ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-14T00:14:29.689ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-14T00:14:29.689ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool)
322024-11-14T00:14:29.818ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal }
332024-11-14T00:14:30.407ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-14T00:14:30.407ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-14T00:14:30.407ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-14T00:14:30.407ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-14T00:14:30.407ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
382024-11-14T00:14:30.407ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
392024-11-14T00:14:30.407ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
402024-11-14T00:14:30.407ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
412024-11-14T00:14:30.407ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
422024-11-14T00:14:30.407ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
432024-11-14T00:14:30.416ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
442024-11-14T00:14:30.416ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool)
452024-11-14T00:14:30.521ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal }
462024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
472024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
482024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
492024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
502024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
512024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
522024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
532024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
542024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
552024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
562024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
582024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
592024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
602024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
612024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
622024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
632024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
642024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
652024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
672024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
682024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
692024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
702024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
712024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
722024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
732024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
742024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
752024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
762024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
772024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
782024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
792024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
802024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
812024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
822024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
832024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
842024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
882024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
892024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
902024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
912024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
922024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-11-14T00:14:31.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
952024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
962024-11-14T00:14:31.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
982024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-11-14T00:14:31.123ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1012024-11-14T00:14:31.123ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022024-11-14T00:14:31.123ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-14T00:14:31.123ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1042024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1052024-11-14T00:14:31.123ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1062024-11-14T00:14:31.123ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1072024-11-14T00:14:31.123ZINFOSledAgent (bootstore): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-14T00:14:31.123ZINFOSledAgent (bootstore): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-14T00:14:31.123ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1102024-11-14T00:14:31.123ZINFOSledAgent (bootstore): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1112024-11-14T00:14:31.123ZINFOSledAgent (bootstore): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1122024-11-14T00:14:31.123ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1132024-11-14T00:14:31.123ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1142024-11-14T00:14:31.123ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1152024-11-14T00:14:31.134ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1162024-11-14T00:14:31.134ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1370, tv_nsec: 124196492 } time_to_next_cleanup = 599.999946589s
1172024-11-14T00:14:31.134ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1182024-11-14T00:14:31.134ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1192024-11-14T00:14:31.134ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/sled-agent-request.json file = common/src/ledger.rs:188
1202024-11-14T00:14:31.137ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/sled-agent-request.json file = common/src/ledger.rs:188
1212024-11-14T00:14:31.137ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1222024-11-14T00:14:31.139ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1232024-11-14T00:14:31.139ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1198
1242024-11-14T00:14:31.139ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1252024-11-14T00:14:31.139ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1262024-11-14T00:14:31.139ZINFOSledAgent (RSS): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-11-14T00:14:31.140ZINFOSledAgent (RSS): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-11-14T00:14:31.140ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1261
1292024-11-14T00:14:31.140ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1302024-11-14T00:14:31.140ZINFOSledAgent (RSS): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/rss-sled-plan.json file = common/src/ledger.rs:188
1312024-11-14T00:14:31.140ZINFOSledAgent (RSS): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/rss-sled-plan.json file = common/src/ledger.rs:188
1322024-11-14T00:14:31.140ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1303
1332024-11-14T00:14:31.140ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1342024-11-14T00:14:31.140ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1352024-11-14T00:14:31.140ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1362024-11-14T00:14:31.140ZINFOSledAgent (RSS): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1372024-11-14T00:14:31.140ZINFOSledAgent (RSS): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1382024-11-14T00:14:31.140ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e211d163-be78-4663-b73f-baf5e9462a10 (sled), rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1392024-11-14T00:14:31.140ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1337
1402024-11-14T00:14:31.140ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1412024-11-14T00:14:31.140ZINFOSledAgent (bootstore): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1422024-11-14T00:14:31.140ZINFOSledAgent (bootstore): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1432024-11-14T00:14:31.140ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1442024-11-14T00:14:31.141ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e211d163-be78-4663-b73f-baf5e9462a10 (sled), rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1452024-11-14T00:14:31.141ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1462024-11-14T00:14:31.141ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1472024-11-14T00:14:31.145ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1482024-11-14T00:14:31.151ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1492024-11-14T00:14:31.151ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1502024-11-14T00:14:31.156ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1512024-11-14T00:14:31.156ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1522024-11-14T00:14:31.156ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:40260
1532024-11-14T00:14:31.156ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e211d163-be78-4663-b73f-baf5e9462a10 (sled), rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1542024-11-14T00:14:31.156ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1552024-11-14T00:14:31.156ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1562024-11-14T00:14:31.156ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1572024-11-14T00:14:31.156ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1582024-11-14T00:14:31.156ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1592024-11-14T00:14:31.156ZINFOSledAgent (StorageManager): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1602024-11-14T00:14:31.156ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1612024-11-14T00:14:31.156ZINFOSledAgent (StorageManager): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1622024-11-14T00:14:31.156ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1632024-11-14T00:14:31.156ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1642024-11-14T00:14:31.156ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1652024-11-14T00:14:31.156ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1662024-11-14T00:14:31.156ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1672024-11-14T00:14:31.172ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1682024-11-14T00:14:31.192ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1692024-11-14T00:14:31.208ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1702024-11-14T00:14:31.218ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
1712024-11-14T00:14:31.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1722024-11-14T00:14:31.218ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
1732024-11-14T00:14:31.218ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-11-14T00:14:31.222ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 88.544069ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1437173f-5498-4e0a-9fce-e03265451fec", "content-length": "124", "date": "Thu, 14 Nov 2024 00:14:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1437173f-5498-4e0a-9fce-e03265451fec" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-11-14T00:14:31.232ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_eb4b0661-72a7-4ce4-82b1-8d09387e21aa/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1762024-11-14T00:14:31.265ZINFOSledAgent: successfully created encrypted zvol: name="oxi_eb4b0661-72a7-4ce4-82b1-8d09387e21aa/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1772024-11-14T00:14:31.265ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_eb4b0661-72a7-4ce4-82b1-8d09387e21aa/swap" file = sled-agent/src/swap_device.rs:96
1782024-11-14T00:14:31.270ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
1792024-11-14T00:14:31.270ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1802024-11-14T00:14:31.270ZINFOSledAgent (BackingFs): Ensuring dataset oxi_eb4b0661-72a7-4ce4-82b1-8d09387e21aa/backing/fmd file = sled-agent/src/backing_fs.rs:138
1812024-11-14T00:14:31.311ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-14T00:14:31.312ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 174.229685ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2198ad9b-9005-440f-b37b-091ce7e94268", "content-length": "124", "date": "Thu, 14 Nov 2024 00:14:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2198ad9b-9005-440f-b37b-091ce7e94268" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-14T00:14:31.366ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1842024-11-14T00:14:31.487ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-11-14T00:14:31.488ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 201.716781ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "85a5026f-ac81-4f77-acfd-df46783a1dc6", "content-length": "124", "date": "Thu, 14 Nov 2024 00:14:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "85a5026f-ac81-4f77-acfd-df46783a1dc6" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-11-14T00:14:31.584ZINFOSledAgent (BackingFs): Mounting oxi_eb4b0661-72a7-4ce4-82b1-8d09387e21aa/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1872024-11-14T00:14:31.597ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1882024-11-14T00:14:31.597ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1892024-11-14T00:14:31.597ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1902024-11-14T00:14:31.597ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1912024-11-14T00:14:31.690ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1922024-11-14T00:14:31.694ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 148.470656ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b8cf880a-7bb3-402a-a751-8a5c8ec704fc", "content-length": "124", "date": "Thu, 14 Nov 2024 00:14:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b8cf880a-7bb3-402a-a751-8a5c8ec704fc" } file = clients/ddm-admin-client/src/lib.rs:177
1932024-11-14T00:14:31.843ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1942024-11-14T00:14:31.847ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 176.53856ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "406854d1-2e83-47ac-8db5-d521957092e1", "content-length": "124", "date": "Thu, 14 Nov 2024 00:14:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "406854d1-2e83-47ac-8db5-d521957092e1" } file = clients/ddm-admin-client/src/lib.rs:177
1952024-11-14T00:14:32.025ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1962024-11-14T00:14:32.026ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 310.539574ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "91375c29-b1ea-4643-a61b-15afc444c881", "content-length": "124", "date": "Thu, 14 Nov 2024 00:14:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "91375c29-b1ea-4643-a61b-15afc444c881" } file = clients/ddm-admin-client/src/lib.rs:177
1972024-11-14T00:14:32.337ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1982024-11-14T00:14:32.358ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
1992024-11-14T00:14:32.364ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:54990 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2002024-11-14T00:14:32.364ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2012024-11-14T00:14:32.364ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:54990 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = e211d163-be78-4663-b73f-baf5e9462a10 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2022024-11-14T00:14:32.365ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 324.044982ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2032024-11-14T00:14:32.366ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2042024-11-14T00:14:32.366ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2052024-11-14T00:14:32.366ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2062024-11-14T00:14:32.366ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2072024-11-14T00:14:32.691ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 271.842459ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2082024-11-14T00:14:32.963ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.151553382s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2092024-11-14T00:14:34.116ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.232194256s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2102024-11-14T00:14:34.810ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2112024-11-14T00:14:34.810ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2122024-11-14T00:14:34.810ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2132024-11-14T00:14:34.810ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2142024-11-14T00:14:34.810ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2152024-11-14T00:14:34.810ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2162024-11-14T00:14:34.811ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2172024-11-14T00:14:34.813ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2182024-11-14T00:14:34.813ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='0867195b-1633-40b0-a3a6-a61f7ba60ba6'/> <propval type="astring" name="rack_id" value='fcfbb675-622a-4d07-9c7d-02f1c7317864'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe0f:1e09'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='fcfbb675-622a-4d07-9c7d-02f1c7317864'/> <propval type="astring" name="sled_id" value='e211d163-be78-4663-b73f-baf5e9462a10'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='e211d163-be78-4663-b73f-baf5e9462a10'/> <propval type="astring" name="rack_uuid" value='fcfbb675-622a-4d07-9c7d-02f1c7317864'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='e211d163-be78-4663-b73f-baf5e9462a10'/> <propval type="astring" name="rack_uuid" value='fcfbb675-622a-4d07-9c7d-02f1c7317864'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2192024-11-14T00:14:34.813ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2202024-11-14T00:14:35.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 59.243875ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-14T00:14:35.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 73.608463ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-14T00:14:35.384ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.63408774s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2232024-11-14T00:14:35.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 107.780934ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-14T00:14:35.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 585.743717ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-14T00:14:36.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.194529441s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-14T00:14:37.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 630.608839ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-14T00:14:38.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.086145127s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-14T00:14:39.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.449516976s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-14T00:14:40.020ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.851724245s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2302024-11-14T00:14:41.475ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/nexus.rs:527 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2312024-11-14T00:14:41.504ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-11-14T00:14:41.505ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2332024-11-14T00:14:41.505ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2342024-11-14T00:14:41.505ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2352024-11-14T00:14:41.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-14T00:14:41.505ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-14T00:14:41.506ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2382024-11-14T00:14:41.506ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2392024-11-14T00:14:41.506ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2402024-11-14T00:14:41.506ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2412024-11-14T00:14:41.506ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:40260
2422024-11-14T00:14:41.687ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2432024-11-14T00:14:41.687ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2442024-11-14T00:14:41.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-11-14T00:14:41.687ZINFOSledAgent (RSS): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-14T00:14:41.687ZINFOSledAgent (RSS): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2472024-11-14T00:14:41.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-14T00:14:41.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-14T00:14:41.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-14T00:14:41.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-14T00:14:41.692ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2522024-11-14T00:14:41.692ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2532024-11-14T00:14:41.692ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2542024-11-14T00:14:41.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55181
2552024-11-14T00:14:41.939ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-14T00:14:41.939ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-14T00:14:41.939ZINFOSledAgent (ServiceManager): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-14T00:14:41.939ZINFOSledAgent (ServiceManager): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:188
2592024-11-14T00:14:41.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 449 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55181 req_id = 3b514726-4cef-4425-bea8-a8b508448781 response_code = 200 uri = /inventory
2602024-11-14T00:14:41.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39023
2612024-11-14T00:14:41.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39023 req_id = 6e3cb455-b461-4ba0-b6b0-9a359b8173e5 response_code = 200 uri = /sled-role
2622024-11-14T00:14:41.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2632024-11-14T00:14:41.971ZINFOSledAgent (RSS): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-14T00:14:41.971ZINFOSledAgent (RSS): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2652024-11-14T00:14:41.972ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2662024-11-14T00:14:42.004ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2d3e2a0a-5fe0-417f-816f-03adc4a78ea4, pool_id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 170a0264-59e8-495b-adc1-4c9367e96fc9, pool_id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 913917b1-7d12-4280-b387-b4b8e3171422, pool_id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: dac1b26c-f042-40b0-a89e-2b5e693e6bc6, pool_id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c8678097-7d5d-4f84-a44a-2c24f4233d41, pool_id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: c7a7dd08-e1ca-44cf-a5af-9dcd64229c29, pool_id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 7d5cb521-ad4e-47d9-9342-9c56cc7bd865, pool_id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 84770920-09ac-4889-b9f1-1d7c7c3a4b89, pool_id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: a941dbb6-d63a-46f5-851f-417406b14b40, pool_id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2672024-11-14T00:14:42.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65408
2682024-11-14T00:14:42.004ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2692024-11-14T00:14:42.004ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2d3e2a0a-5fe0-417f-816f-03adc4a78ea4, pool_id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 170a0264-59e8-495b-adc1-4c9367e96fc9, pool_id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 913917b1-7d12-4280-b387-b4b8e3171422, pool_id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: dac1b26c-f042-40b0-a89e-2b5e693e6bc6, pool_id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c8678097-7d5d-4f84-a44a-2c24f4233d41, pool_id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: c7a7dd08-e1ca-44cf-a5af-9dcd64229c29, pool_id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 7d5cb521-ad4e-47d9-9342-9c56cc7bd865, pool_id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 84770920-09ac-4889-b9f1-1d7c7c3a4b89, pool_id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: a941dbb6-d63a-46f5-851f-417406b14b40, pool_id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2702024-11-14T00:14:42.004ZINFOSledAgent (StorageManager): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-14T00:14:42.004ZINFOSledAgent (StorageManager): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2722024-11-14T00:14:42.004ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2732024-11-14T00:14:42.004ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2742024-11-14T00:14:42.004ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2752024-11-14T00:14:42.004ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2762024-11-14T00:14:42.004ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2772024-11-14T00:14:42.156ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2782024-11-14T00:14:42.156ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool)
2792024-11-14T00:14:42.376ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2802024-11-14T00:14:42.377ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2812024-11-14T00:14:42.377ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2822024-11-14T00:14:42.494ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }
2832024-11-14T00:14:42.502ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2842024-11-14T00:14:42.502ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2852024-11-14T00:14:42.502ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2862024-11-14T00:14:42.502ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2872024-11-14T00:14:42.502ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-14T00:14:42.502ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-14T00:14:42.502ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2902024-11-14T00:14:42.507ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
2912024-11-14T00:14:42.549ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2922024-11-14T00:14:42.557ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone file = sled-storage/src/dataset.rs:303
2932024-11-14T00:14:42.777ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3 file = sled-storage/src/dataset.rs:389
2942024-11-14T00:14:42.785ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2952024-11-14T00:14:42.785ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2962024-11-14T00:14:42.785ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2972024-11-14T00:14:42.785ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2982024-11-14T00:14:42.785ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2992024-11-14T00:14:42.795ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3002024-11-14T00:14:42.795ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5d197ef6-7d58-4152-8a63-88374989a904 (zpool)
3012024-11-14T00:14:42.912ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }
3022024-11-14T00:14:42.921ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3032024-11-14T00:14:42.921ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3042024-11-14T00:14:42.921ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3052024-11-14T00:14:42.921ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3062024-11-14T00:14:42.921ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-14T00:14:42.921ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-11-14T00:14:42.921ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3092024-11-14T00:14:42.966ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3102024-11-14T00:14:42.974ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone file = sled-storage/src/dataset.rs:303
3112024-11-14T00:14:43.196ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5d197ef6-7d58-4152-8a63-88374989a904 file = sled-storage/src/dataset.rs:389
3122024-11-14T00:14:43.205ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-14T00:14:43.205ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-14T00:14:43.205ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-14T00:14:43.205ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-14T00:14:43.205ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-14T00:14:43.214ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-14T00:14:43.214ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool)
3192024-11-14T00:14:43.331ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }
3202024-11-14T00:14:43.339ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3212024-11-14T00:14:43.340ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3222024-11-14T00:14:43.340ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3232024-11-14T00:14:43.340ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3242024-11-14T00:14:43.340ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-14T00:14:43.340ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-14T00:14:43.340ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3272024-11-14T00:14:43.386ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-14T00:14:43.394ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone file = sled-storage/src/dataset.rs:303
3292024-11-14T00:14:43.509ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
3302024-11-14T00:14:43.612ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272 file = sled-storage/src/dataset.rs:389
3312024-11-14T00:14:43.620ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3322024-11-14T00:14:43.620ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3332024-11-14T00:14:43.620ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3342024-11-14T00:14:43.620ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3352024-11-14T00:14:43.620ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3362024-11-14T00:14:43.631ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3372024-11-14T00:14:43.631ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool)
3382024-11-14T00:14:43.749ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }
3392024-11-14T00:14:43.756ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3402024-11-14T00:14:43.756ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3412024-11-14T00:14:43.756ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3422024-11-14T00:14:43.756ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3432024-11-14T00:14:43.756ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-14T00:14:43.756ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3452024-11-14T00:14:43.756ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3462024-11-14T00:14:43.803ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3472024-11-14T00:14:43.811ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone file = sled-storage/src/dataset.rs:303
3482024-11-14T00:14:44.029ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a file = sled-storage/src/dataset.rs:389
3492024-11-14T00:14:44.037ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3502024-11-14T00:14:44.037ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3512024-11-14T00:14:44.037ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3522024-11-14T00:14:44.037ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3532024-11-14T00:14:44.037ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3542024-11-14T00:14:44.047ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3552024-11-14T00:14:44.047ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = da3c518e-c769-471a-bde6-cca14456f7ec (zpool)
3562024-11-14T00:14:44.169ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }
3572024-11-14T00:14:44.176ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3582024-11-14T00:14:44.176ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3592024-11-14T00:14:44.176ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3602024-11-14T00:14:44.176ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3612024-11-14T00:14:44.176ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-14T00:14:44.177ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-11-14T00:14:44.177ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3642024-11-14T00:14:44.222ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-14T00:14:44.229ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_da3c518e-c769-471a-bde6-cca14456f7ec/crypt/zone file = sled-storage/src/dataset.rs:303
3662024-11-14T00:14:44.445ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_da3c518e-c769-471a-bde6-cca14456f7ec file = sled-storage/src/dataset.rs:389
3672024-11-14T00:14:44.453ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-14T00:14:44.453ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-14T00:14:44.453ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-14T00:14:44.453ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-14T00:14:44.453ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-14T00:14:44.462ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-14T00:14:44.462ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool)
3742024-11-14T00:14:44.579ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }
3752024-11-14T00:14:44.587ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3762024-11-14T00:14:44.587ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3772024-11-14T00:14:44.587ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3782024-11-14T00:14:44.587ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3792024-11-14T00:14:44.587ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-14T00:14:44.587ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-14T00:14:44.587ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3822024-11-14T00:14:44.591ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
3832024-11-14T00:14:44.631ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3842024-11-14T00:14:44.638ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/zone file = sled-storage/src/dataset.rs:303
3852024-11-14T00:14:44.871ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12 file = sled-storage/src/dataset.rs:389
3862024-11-14T00:14:44.880ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3872024-11-14T00:14:44.880ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3882024-11-14T00:14:44.880ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3892024-11-14T00:14:44.880ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3902024-11-14T00:14:44.880ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3912024-11-14T00:14:44.890ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3922024-11-14T00:14:44.890ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e6e03840-7feb-4068-8c49-369b714d0403 (zpool)
3932024-11-14T00:14:45.021ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }
3942024-11-14T00:14:45.029ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3952024-11-14T00:14:45.029ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3962024-11-14T00:14:45.029ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3972024-11-14T00:14:45.029ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3982024-11-14T00:14:45.029ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-14T00:14:45.030ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4002024-11-14T00:14:45.030ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4012024-11-14T00:14:45.078ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4022024-11-14T00:14:45.085ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e6e03840-7feb-4068-8c49-369b714d0403/crypt/zone file = sled-storage/src/dataset.rs:303
4032024-11-14T00:14:45.305ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e6e03840-7feb-4068-8c49-369b714d0403 file = sled-storage/src/dataset.rs:389
4042024-11-14T00:14:45.314ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4052024-11-14T00:14:45.314ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4062024-11-14T00:14:45.314ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4072024-11-14T00:14:45.314ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082024-11-14T00:14:45.314ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4092024-11-14T00:14:45.324ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4102024-11-14T00:14:45.324ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool)
4112024-11-14T00:14:45.443ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }
4122024-11-14T00:14:45.451ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4132024-11-14T00:14:45.451ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4142024-11-14T00:14:45.451ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4152024-11-14T00:14:45.451ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4162024-11-14T00:14:45.451ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-14T00:14:45.451ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-11-14T00:14:45.451ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4192024-11-14T00:14:45.494ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-14T00:14:45.502ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/zone file = sled-storage/src/dataset.rs:303
4212024-11-14T00:14:45.597ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4222024-11-14T00:14:45.724ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b file = sled-storage/src/dataset.rs:389
4232024-11-14T00:14:45.733ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4242024-11-14T00:14:45.733ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4252024-11-14T00:14:45.733ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4262024-11-14T00:14:45.733ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4272024-11-14T00:14:45.733ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4282024-11-14T00:14:45.743ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4292024-11-14T00:14:45.743ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool)
4302024-11-14T00:14:45.864ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }
4312024-11-14T00:14:45.872ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4322024-11-14T00:14:45.872ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4332024-11-14T00:14:45.872ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4342024-11-14T00:14:45.872ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4352024-11-14T00:14:45.872ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-14T00:14:45.872ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4372024-11-14T00:14:45.872ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4382024-11-14T00:14:45.876ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 18.793379629s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4392024-11-14T00:14:45.916ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4402024-11-14T00:14:45.924ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/zone file = sled-storage/src/dataset.rs:303
4412024-11-14T00:14:46.147ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 file = sled-storage/src/dataset.rs:389
4422024-11-14T00:14:46.155ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4432024-11-14T00:14:46.155ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4442024-11-14T00:14:46.155ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4452024-11-14T00:14:46.155ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb4b0661-72a7-4ce4-82b1-8d09387e21aa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d2211c-ebdf-4b88-9756-46c1105ccb84 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4462024-11-14T00:14:46.155ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4472024-11-14T00:14:46.155ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4482024-11-14T00:14:46.155ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4492024-11-14T00:14:46.155ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4502024-11-14T00:14:46.155ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4512024-11-14T00:14:46.155ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4522024-11-14T00:14:46.155ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4532024-11-14T00:14:46.155ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4542024-11-14T00:14:46.155ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4552024-11-14T00:14:46.155ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4562024-11-14T00:14:46.155ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4572024-11-14T00:14:46.155ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4582024-11-14T00:14:46.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4151523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:65408 req_id = 12992d0f-14a8-47c8-ad0b-8d579d87482f response_code = 200 uri = /omicron-physical-disks
4592024-11-14T00:14:46.187ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00eea963-586d-47bf-a9b8-dbe01b67f663 (dataset): DatasetConfig { id: 00eea963-586d-47bf-a9b8-dbe01b67f663 (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05541dd2-c929-4335-b657-2a6df944a135 (dataset): DatasetConfig { id: 05541dd2-c929-4335-b657-2a6df944a135 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0bf41bd7-7c18-4ac7-9a37-048cdbb46af1 (dataset): DatasetConfig { id: 0bf41bd7-7c18-4ac7-9a37-048cdbb46af1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0feec6ae-9490-4d2c-9147-f4bee72fa022 (dataset): DatasetConfig { id: 0feec6ae-9490-4d2c-9147-f4bee72fa022 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a53d5a8-49d3-403f-b622-2dd379a5193a (dataset): DatasetConfig { id: 1a53d5a8-49d3-403f-b622-2dd379a5193a (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1f52f227-ae0e-4f97-accf-c63fb3021bef (dataset): DatasetConfig { id: 1f52f227-ae0e-4f97-accf-c63fb3021bef (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 224e07ad-b391-4bd4-bd53-33964f027fcd (dataset): DatasetConfig { id: 224e07ad-b391-4bd4-bd53-33964f027fcd (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 238ce0bd-bb27-46fb-9260-21baff8d74e6 (dataset): DatasetConfig { id: 238ce0bd-bb27-46fb-9260-21baff8d74e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2856c38c-f5a3-40f4-b0f0-9ffa8b3fd2ca (dataset): DatasetConfig { id: 2856c38c-f5a3-40f4-b0f0-9ffa8b3fd2ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30a2d7cf-2c56-4964-9672-6719b8ef2cad (dataset): DatasetConfig { id: 30a2d7cf-2c56-4964-9672-6719b8ef2cad (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 319f9e0f-df9f-4132-93c0-867a217d9075 (dataset): DatasetConfig { id: 319f9e0f-df9f-4132-93c0-867a217d9075 (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fcba0e3-6cb5-4e79-b2e4-af0b2407d858 (dataset): DatasetConfig { id: 3fcba0e3-6cb5-4e79-b2e4-af0b2407d858 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 413889cb-8f45-449d-b915-43d90d0c9d83 (dataset): DatasetConfig { id: 413889cb-8f45-449d-b915-43d90d0c9d83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 425e97e0-186c-44be-960c-edbefdb7c934 (dataset): DatasetConfig { id: 425e97e0-186c-44be-960c-edbefdb7c934 (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 46b22f19-bde0-4cab-bd7d-274cca576fe2 (dataset): DatasetConfig { id: 46b22f19-bde0-4cab-bd7d-274cca576fe2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c30e8ab-e09e-4842-8cfc-c927422f4b12 (dataset): DatasetConfig { id: 4c30e8ab-e09e-4842-8cfc-c927422f4b12 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e1d83b2-6564-48aa-9e26-ac2ba8069baf (dataset): DatasetConfig { id: 4e1d83b2-6564-48aa-9e26-ac2ba8069baf (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 504ba305-6ece-4105-aee4-186428b20555 (dataset): DatasetConfig { id: 504ba305-6ece-4105-aee4-186428b20555 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50963e23-cd80-4dad-8932-033a5d33f51d (dataset): DatasetConfig { id: 50963e23-cd80-4dad-8932-033a5d33f51d (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52215300-6c77-463a-a6a8-25257b3dc1dd (dataset): DatasetConfig { id: 52215300-6c77-463a-a6a8-25257b3dc1dd (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59b6924d-6d13-4760-8a98-4bd967aff6ea (dataset): DatasetConfig { id: 59b6924d-6d13-4760-8a98-4bd967aff6ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fb2a997-ee6d-4ef2-88eb-79df0129acc2 (dataset): DatasetConfig { id: 5fb2a997-ee6d-4ef2-88eb-79df0129acc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 614f15e5-2a24-44d0-95aa-b919fa3a1d11 (dataset): DatasetConfig { id: 614f15e5-2a24-44d0-95aa-b919fa3a1d11 (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65bb41ef-1296-4f0e-aa3d-937b643be465 (dataset): DatasetConfig { id: 65bb41ef-1296-4f0e-aa3d-937b643be465 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6bd173cc-e9cc-4afb-9354-7b2bb7bc83e4 (dataset): DatasetConfig { id: 6bd173cc-e9cc-4afb-9354-7b2bb7bc83e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bae2c7c-8bc9-4646-b554-f098eda9d5ad (dataset): DatasetConfig { id: 7bae2c7c-8bc9-4646-b554-f098eda9d5ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d936ae2-88cf-4a17-a57e-6ffd30799368 (dataset): DatasetConfig { id: 7d936ae2-88cf-4a17-a57e-6ffd30799368 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80199466-d1ef-4057-b574-15489ee8e30b (dataset): DatasetConfig { id: 80199466-d1ef-4057-b574-15489ee8e30b (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82754ed0-b241-4fe8-b5b8-5c22a5ee3936 (dataset): DatasetConfig { id: 82754ed0-b241-4fe8-b5b8-5c22a5ee3936 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82eeb3a0-16aa-4d16-aba4-047c368cd9f4 (dataset): DatasetConfig { id: 82eeb3a0-16aa-4d16-aba4-047c368cd9f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8971835b-6798-41e1-86c4-1a7a38a3502e (dataset): DatasetConfig { id: 8971835b-6798-41e1-86c4-1a7a38a3502e (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e71935a-b9a3-481c-8388-952ce60cf6ae (dataset): DatasetConfig { id: 8e71935a-b9a3-481c-8388-952ce60cf6ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91c4d10d-327a-47cf-9ef4-e29820a6e447 (dataset): DatasetConfig { id: 91c4d10d-327a-47cf-9ef4-e29820a6e447 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95aebe99-5fa3-4d52-944b-a04734393920 (dataset): DatasetConfig { id: 95aebe99-5fa3-4d52-944b-a04734393920 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d410d5c-a313-4b47-b47f-685ee96537ed (dataset): DatasetConfig { id: 9d410d5c-a313-4b47-b47f-685ee96537ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2234fd4-f64b-4d52-8962-28eff0964e7c (dataset): DatasetConfig { id: a2234fd4-f64b-4d52-8962-28eff0964e7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2cae68f-d633-489a-9a51-4143d7c69709 (dataset): DatasetConfig { id: a2cae68f-d633-489a-9a51-4143d7c69709 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a474a347-a131-4ee8-a497-f0ae104ccac8 (dataset): DatasetConfig { id: a474a347-a131-4ee8-a497-f0ae104ccac8 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7b63b8f-7bbf-4de8-a9b1-dad184911ce7 (dataset): DatasetConfig { id: a7b63b8f-7bbf-4de8-a9b1-dad184911ce7 (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adcd122e-f28f-4ba0-b6ea-6e532b0ab7e8 (dataset): DatasetConfig { id: adcd122e-f28f-4ba0-b6ea-6e532b0ab7e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae23fedf-0090-4c3c-badb-4f3b8ab68209 (dataset): DatasetConfig { id: ae23fedf-0090-4c3c-badb-4f3b8ab68209 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af85330f-3759-4c3e-8d12-7a5f7436293d (dataset): DatasetConfig { id: af85330f-3759-4c3e-8d12-7a5f7436293d (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b245a9c7-649c-4cc2-8953-f77c88f747f3 (dataset): DatasetConfig { id: b245a9c7-649c-4cc2-8953-f77c88f747f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2f9ca6b-5ffe-458c-89b3-ce758ccd4436 (dataset): DatasetConfig { id: b2f9ca6b-5ffe-458c-89b3-ce758ccd4436 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5017d85-cddc-4f19-ab78-db503604cc61 (dataset): DatasetConfig { id: b5017d85-cddc-4f19-ab78-db503604cc61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c145bcca-a142-4360-a616-c0668733ef47 (dataset): DatasetConfig { id: c145bcca-a142-4360-a616-c0668733ef47 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c261aa41-6b1b-4d4f-bbe8-d81005aff074 (dataset): DatasetConfig { id: c261aa41-6b1b-4d4f-bbe8-d81005aff074 (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c84ccb80-e8db-448f-90f0-d49b434f2636 (dataset): DatasetConfig { id: c84ccb80-e8db-448f-90f0-d49b434f2636 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c89762f4-8949-4265-891a-d9f860a7ac6c (dataset): DatasetConfig { id: c89762f4-8949-4265-891a-d9f860a7ac6c (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cae8fe28-b115-42ef-8d28-5fd68d2e1d89 (dataset): DatasetConfig { id: cae8fe28-b115-42ef-8d28-5fd68d2e1d89 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc2f7b2c-428e-4015-9422-4f1858639115 (dataset): DatasetConfig { id: cc2f7b2c-428e-4015-9422-4f1858639115 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc6bd7f7-3d96-4019-81d8-44c5a2d32c3d (dataset): DatasetConfig { id: cc6bd7f7-3d96-4019-81d8-44c5a2d32c3d (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf4b1089-9801-409e-9b10-b59c6f64c955 (dataset): DatasetConfig { id: cf4b1089-9801-409e-9b10-b59c6f64c955 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cfa23015-fd2d-4b22-a608-e2e3dcd6ddeb (dataset): DatasetConfig { id: cfa23015-fd2d-4b22-a608-e2e3dcd6ddeb (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5b79901-e97e-4aee-822a-dc72154d5432 (dataset): DatasetConfig { id: d5b79901-e97e-4aee-822a-dc72154d5432 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d85ed2e2-80a2-4593-b9cc-3a432e38b1c3 (dataset): DatasetConfig { id: d85ed2e2-80a2-4593-b9cc-3a432e38b1c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, deec6eb4-26f3-4066-a9ae-9f49f0ebb9b2 (dataset): DatasetConfig { id: deec6eb4-26f3-4066-a9ae-9f49f0ebb9b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e1f61d81-751b-48f6-b35d-3ef06470655b (dataset): DatasetConfig { id: e1f61d81-751b-48f6-b35d-3ef06470655b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5463f3d-8fd4-4a53-af8e-56b4db7f0834 (dataset): DatasetConfig { id: e5463f3d-8fd4-4a53-af8e-56b4db7f0834 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec64fc6f-b211-4a80-b9d3-e4cd3b0e3e5d (dataset): DatasetConfig { id: ec64fc6f-b211-4a80-b9d3-e4cd3b0e3e5d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2294ace-aa5a-4a18-a922-92510e9a8b3b (dataset): DatasetConfig { id: f2294ace-aa5a-4a18-a922-92510e9a8b3b (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f448082e-0181-4bab-8d19-8f8b3bb021f5 (dataset): DatasetConfig { id: f448082e-0181-4bab-8d19-8f8b3bb021f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f776634e-a59f-4983-9f74-e0aae8f04f17 (dataset): DatasetConfig { id: f776634e-a59f-4983-9f74-e0aae8f04f17 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb8e7e2d-1f17-40e7-ae39-cac9231a717d (dataset): DatasetConfig { id: fb8e7e2d-1f17-40e7-ae39-cac9231a717d (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd8c046a-aa45-40dd-9844-7b6596dbc9c4 (dataset): DatasetConfig { id: fd8c046a-aa45-40dd-9844-7b6596dbc9c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdda25d7-2d6b-401d-8b44-38b806b0892d (dataset): DatasetConfig { id: fdda25d7-2d6b-401d-8b44-38b806b0892d (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4602024-11-14T00:14:46.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41752
4612024-11-14T00:14:46.187ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4622024-11-14T00:14:46.187ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00eea963-586d-47bf-a9b8-dbe01b67f663 (dataset): DatasetConfig { id: 00eea963-586d-47bf-a9b8-dbe01b67f663 (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05541dd2-c929-4335-b657-2a6df944a135 (dataset): DatasetConfig { id: 05541dd2-c929-4335-b657-2a6df944a135 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0bf41bd7-7c18-4ac7-9a37-048cdbb46af1 (dataset): DatasetConfig { id: 0bf41bd7-7c18-4ac7-9a37-048cdbb46af1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0feec6ae-9490-4d2c-9147-f4bee72fa022 (dataset): DatasetConfig { id: 0feec6ae-9490-4d2c-9147-f4bee72fa022 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a53d5a8-49d3-403f-b622-2dd379a5193a (dataset): DatasetConfig { id: 1a53d5a8-49d3-403f-b622-2dd379a5193a (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1f52f227-ae0e-4f97-accf-c63fb3021bef (dataset): DatasetConfig { id: 1f52f227-ae0e-4f97-accf-c63fb3021bef (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 224e07ad-b391-4bd4-bd53-33964f027fcd (dataset): DatasetConfig { id: 224e07ad-b391-4bd4-bd53-33964f027fcd (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 238ce0bd-bb27-46fb-9260-21baff8d74e6 (dataset): DatasetConfig { id: 238ce0bd-bb27-46fb-9260-21baff8d74e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2856c38c-f5a3-40f4-b0f0-9ffa8b3fd2ca (dataset): DatasetConfig { id: 2856c38c-f5a3-40f4-b0f0-9ffa8b3fd2ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30a2d7cf-2c56-4964-9672-6719b8ef2cad (dataset): DatasetConfig { id: 30a2d7cf-2c56-4964-9672-6719b8ef2cad (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 319f9e0f-df9f-4132-93c0-867a217d9075 (dataset): DatasetConfig { id: 319f9e0f-df9f-4132-93c0-867a217d9075 (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fcba0e3-6cb5-4e79-b2e4-af0b2407d858 (dataset): DatasetConfig { id: 3fcba0e3-6cb5-4e79-b2e4-af0b2407d858 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 413889cb-8f45-449d-b915-43d90d0c9d83 (dataset): DatasetConfig { id: 413889cb-8f45-449d-b915-43d90d0c9d83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 425e97e0-186c-44be-960c-edbefdb7c934 (dataset): DatasetConfig { id: 425e97e0-186c-44be-960c-edbefdb7c934 (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 46b22f19-bde0-4cab-bd7d-274cca576fe2 (dataset): DatasetConfig { id: 46b22f19-bde0-4cab-bd7d-274cca576fe2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c30e8ab-e09e-4842-8cfc-c927422f4b12 (dataset): DatasetConfig { id: 4c30e8ab-e09e-4842-8cfc-c927422f4b12 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e1d83b2-6564-48aa-9e26-ac2ba8069baf (dataset): DatasetConfig { id: 4e1d83b2-6564-48aa-9e26-ac2ba8069baf (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 504ba305-6ece-4105-aee4-186428b20555 (dataset): DatasetConfig { id: 504ba305-6ece-4105-aee4-186428b20555 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50963e23-cd80-4dad-8932-033a5d33f51d (dataset): DatasetConfig { id: 50963e23-cd80-4dad-8932-033a5d33f51d (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52215300-6c77-463a-a6a8-25257b3dc1dd (dataset): DatasetConfig { id: 52215300-6c77-463a-a6a8-25257b3dc1dd (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59b6924d-6d13-4760-8a98-4bd967aff6ea (dataset): DatasetConfig { id: 59b6924d-6d13-4760-8a98-4bd967aff6ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fb2a997-ee6d-4ef2-88eb-79df0129acc2 (dataset): DatasetConfig { id: 5fb2a997-ee6d-4ef2-88eb-79df0129acc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 614f15e5-2a24-44d0-95aa-b919fa3a1d11 (dataset): DatasetConfig { id: 614f15e5-2a24-44d0-95aa-b919fa3a1d11 (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65bb41ef-1296-4f0e-aa3d-937b643be465 (dataset): DatasetConfig { id: 65bb41ef-1296-4f0e-aa3d-937b643be465 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6bd173cc-e9cc-4afb-9354-7b2bb7bc83e4 (dataset): DatasetConfig { id: 6bd173cc-e9cc-4afb-9354-7b2bb7bc83e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bae2c7c-8bc9-4646-b554-f098eda9d5ad (dataset): DatasetConfig { id: 7bae2c7c-8bc9-4646-b554-f098eda9d5ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d936ae2-88cf-4a17-a57e-6ffd30799368 (dataset): DatasetConfig { id: 7d936ae2-88cf-4a17-a57e-6ffd30799368 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80199466-d1ef-4057-b574-15489ee8e30b (dataset): DatasetConfig { id: 80199466-d1ef-4057-b574-15489ee8e30b (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82754ed0-b241-4fe8-b5b8-5c22a5ee3936 (dataset): DatasetConfig { id: 82754ed0-b241-4fe8-b5b8-5c22a5ee3936 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82eeb3a0-16aa-4d16-aba4-047c368cd9f4 (dataset): DatasetConfig { id: 82eeb3a0-16aa-4d16-aba4-047c368cd9f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8971835b-6798-41e1-86c4-1a7a38a3502e (dataset): DatasetConfig { id: 8971835b-6798-41e1-86c4-1a7a38a3502e (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e71935a-b9a3-481c-8388-952ce60cf6ae (dataset): DatasetConfig { id: 8e71935a-b9a3-481c-8388-952ce60cf6ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91c4d10d-327a-47cf-9ef4-e29820a6e447 (dataset): DatasetConfig { id: 91c4d10d-327a-47cf-9ef4-e29820a6e447 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95aebe99-5fa3-4d52-944b-a04734393920 (dataset): DatasetConfig { id: 95aebe99-5fa3-4d52-944b-a04734393920 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d410d5c-a313-4b47-b47f-685ee96537ed (dataset): DatasetConfig { id: 9d410d5c-a313-4b47-b47f-685ee96537ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2234fd4-f64b-4d52-8962-28eff0964e7c (dataset): DatasetConfig { id: a2234fd4-f64b-4d52-8962-28eff0964e7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2cae68f-d633-489a-9a51-4143d7c69709 (dataset): DatasetConfig { id: a2cae68f-d633-489a-9a51-4143d7c69709 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a474a347-a131-4ee8-a497-f0ae104ccac8 (dataset): DatasetConfig { id: a474a347-a131-4ee8-a497-f0ae104ccac8 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7b63b8f-7bbf-4de8-a9b1-dad184911ce7 (dataset): DatasetConfig { id: a7b63b8f-7bbf-4de8-a9b1-dad184911ce7 (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adcd122e-f28f-4ba0-b6ea-6e532b0ab7e8 (dataset): DatasetConfig { id: adcd122e-f28f-4ba0-b6ea-6e532b0ab7e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae23fedf-0090-4c3c-badb-4f3b8ab68209 (dataset): DatasetConfig { id: ae23fedf-0090-4c3c-badb-4f3b8ab68209 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af85330f-3759-4c3e-8d12-7a5f7436293d (dataset): DatasetConfig { id: af85330f-3759-4c3e-8d12-7a5f7436293d (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b245a9c7-649c-4cc2-8953-f77c88f747f3 (dataset): DatasetConfig { id: b245a9c7-649c-4cc2-8953-f77c88f747f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2f9ca6b-5ffe-458c-89b3-ce758ccd4436 (dataset): DatasetConfig { id: b2f9ca6b-5ffe-458c-89b3-ce758ccd4436 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5017d85-cddc-4f19-ab78-db503604cc61 (dataset): DatasetConfig { id: b5017d85-cddc-4f19-ab78-db503604cc61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c145bcca-a142-4360-a616-c0668733ef47 (dataset): DatasetConfig { id: c145bcca-a142-4360-a616-c0668733ef47 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c261aa41-6b1b-4d4f-bbe8-d81005aff074 (dataset): DatasetConfig { id: c261aa41-6b1b-4d4f-bbe8-d81005aff074 (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c84ccb80-e8db-448f-90f0-d49b434f2636 (dataset): DatasetConfig { id: c84ccb80-e8db-448f-90f0-d49b434f2636 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c89762f4-8949-4265-891a-d9f860a7ac6c (dataset): DatasetConfig { id: c89762f4-8949-4265-891a-d9f860a7ac6c (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cae8fe28-b115-42ef-8d28-5fd68d2e1d89 (dataset): DatasetConfig { id: cae8fe28-b115-42ef-8d28-5fd68d2e1d89 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc2f7b2c-428e-4015-9422-4f1858639115 (dataset): DatasetConfig { id: cc2f7b2c-428e-4015-9422-4f1858639115 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc6bd7f7-3d96-4019-81d8-44c5a2d32c3d (dataset): DatasetConfig { id: cc6bd7f7-3d96-4019-81d8-44c5a2d32c3d (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf4b1089-9801-409e-9b10-b59c6f64c955 (dataset): DatasetConfig { id: cf4b1089-9801-409e-9b10-b59c6f64c955 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cfa23015-fd2d-4b22-a608-e2e3dcd6ddeb (dataset): DatasetConfig { id: cfa23015-fd2d-4b22-a608-e2e3dcd6ddeb (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5b79901-e97e-4aee-822a-dc72154d5432 (dataset): DatasetConfig { id: d5b79901-e97e-4aee-822a-dc72154d5432 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d85ed2e2-80a2-4593-b9cc-3a432e38b1c3 (dataset): DatasetConfig { id: d85ed2e2-80a2-4593-b9cc-3a432e38b1c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, deec6eb4-26f3-4066-a9ae-9f49f0ebb9b2 (dataset): DatasetConfig { id: deec6eb4-26f3-4066-a9ae-9f49f0ebb9b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e1f61d81-751b-48f6-b35d-3ef06470655b (dataset): DatasetConfig { id: e1f61d81-751b-48f6-b35d-3ef06470655b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5463f3d-8fd4-4a53-af8e-56b4db7f0834 (dataset): DatasetConfig { id: e5463f3d-8fd4-4a53-af8e-56b4db7f0834 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec64fc6f-b211-4a80-b9d3-e4cd3b0e3e5d (dataset): DatasetConfig { id: ec64fc6f-b211-4a80-b9d3-e4cd3b0e3e5d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2294ace-aa5a-4a18-a922-92510e9a8b3b (dataset): DatasetConfig { id: f2294ace-aa5a-4a18-a922-92510e9a8b3b (dataset), name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f448082e-0181-4bab-8d19-8f8b3bb021f5 (dataset): DatasetConfig { id: f448082e-0181-4bab-8d19-8f8b3bb021f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f776634e-a59f-4983-9f74-e0aae8f04f17 (dataset): DatasetConfig { id: f776634e-a59f-4983-9f74-e0aae8f04f17 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb8e7e2d-1f17-40e7-ae39-cac9231a717d (dataset): DatasetConfig { id: fb8e7e2d-1f17-40e7-ae39-cac9231a717d (dataset), name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd8c046a-aa45-40dd-9844-7b6596dbc9c4 (dataset): DatasetConfig { id: fd8c046a-aa45-40dd-9844-7b6596dbc9c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdda25d7-2d6b-401d-8b44-38b806b0892d (dataset): DatasetConfig { id: fdda25d7-2d6b-401d-8b44-38b806b0892d (dataset), name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4632024-11-14T00:14:46.187ZINFOSledAgent (StorageManager): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4642024-11-14T00:14:46.187ZINFOSledAgent (StorageManager): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4652024-11-14T00:14:46.187ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4662024-11-14T00:14:46.187ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-11-14T00:14:46.187ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone"), full_name: "oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone" } file = sled-storage/src/manager.rs:1331
4682024-11-14T00:14:46.271ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-11-14T00:14:46.271ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d197ef6-7d58-4152-8a63-88374989a904/crypt/debug"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/debug" } file = sled-storage/src/manager.rs:1331
4702024-11-14T00:14:46.356ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-11-14T00:14:46.356ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crucible" } file = sled-storage/src/manager.rs:1331
4722024-11-14T00:14:46.468ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-11-14T00:14:46.468ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6e03840-7feb-4068-8c49-369b714d0403/crypt/debug"), full_name: "oxp_e6e03840-7feb-4068-8c49-369b714d0403/crypt/debug" } file = sled-storage/src/manager.rs:1331
4742024-11-14T00:14:46.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-11-14T00:14:46.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/debug"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/debug" } file = sled-storage/src/manager.rs:1331
4762024-11-14T00:14:46.600ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4772024-11-14T00:14:46.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-14T00:14:46.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/debug"), full_name: "oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/debug" } file = sled-storage/src/manager.rs:1331
4792024-11-14T00:14:46.725ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-14T00:14:46.725ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4812024-11-14T00:14:46.846ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-14T00:14:46.846ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crucible" } file = sled-storage/src/manager.rs:1331
4832024-11-14T00:14:46.960ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-11-14T00:14:46.960ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/zone"), full_name: "oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/zone" } file = sled-storage/src/manager.rs:1331
4852024-11-14T00:14:47.045ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-11-14T00:14:47.045ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da3c518e-c769-471a-bde6-cca14456f7ec/crypt/zone/oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01"), full_name: "oxp_da3c518e-c769-471a-bde6-cca14456f7ec/crypt/zone/oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01" } file = sled-storage/src/manager.rs:1331
4872024-11-14T00:14:47.169ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-14T00:14:47.169ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da3c518e-c769-471a-bde6-cca14456f7ec/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4892024-11-14T00:14:47.283ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-11-14T00:14:47.283ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d" } file = sled-storage/src/manager.rs:1331
4912024-11-14T00:14:47.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-11-14T00:14:47.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/debug"), full_name: "oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/debug" } file = sled-storage/src/manager.rs:1331
4932024-11-14T00:14:47.493ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942024-11-14T00:14:47.493ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/debug"), full_name: "oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/debug" } file = sled-storage/src/manager.rs:1331
4952024-11-14T00:14:47.578ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-11-14T00:14:47.578ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crucible" } file = sled-storage/src/manager.rs:1331
4972024-11-14T00:14:47.603ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
4982024-11-14T00:14:47.695ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-14T00:14:47.695ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6" } file = sled-storage/src/manager.rs:1331
5002024-11-14T00:14:47.818ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-11-14T00:14:47.818ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b/crucible" } file = sled-storage/src/manager.rs:1331
5022024-11-14T00:14:47.933ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-14T00:14:47.933ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d" } file = sled-storage/src/manager.rs:1331
5042024-11-14T00:14:48.060ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-14T00:14:48.060ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305" } file = sled-storage/src/manager.rs:1331
5062024-11-14T00:14:48.187ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-14T00:14:48.187ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6e03840-7feb-4068-8c49-369b714d0403/crypt/zone/oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f"), full_name: "oxp_e6e03840-7feb-4068-8c49-369b714d0403/crypt/zone/oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f" } file = sled-storage/src/manager.rs:1331
5082024-11-14T00:14:48.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-14T00:14:48.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone/oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1"), full_name: "oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone/oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1" } file = sled-storage/src/manager.rs:1331
5102024-11-14T00:14:48.434ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-14T00:14:48.434ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e" } file = sled-storage/src/manager.rs:1331
5122024-11-14T00:14:48.557ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-11-14T00:14:48.557ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da3c518e-c769-471a-bde6-cca14456f7ec/crypt/zone"), full_name: "oxp_da3c518e-c769-471a-bde6-cca14456f7ec/crypt/zone" } file = sled-storage/src/manager.rs:1331
5142024-11-14T00:14:48.606ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
5152024-11-14T00:14:48.642ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-11-14T00:14:48.642ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/zone/oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2"), full_name: "oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/zone/oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2" } file = sled-storage/src/manager.rs:1331
5172024-11-14T00:14:48.766ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-14T00:14:48.766ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4" } file = sled-storage/src/manager.rs:1331
5192024-11-14T00:14:48.883ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-14T00:14:48.883ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crucible" } file = sled-storage/src/manager.rs:1331
5212024-11-14T00:14:48.992ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-14T00:14:48.992ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6e03840-7feb-4068-8c49-369b714d0403/crypt/zone/oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13"), full_name: "oxp_e6e03840-7feb-4068-8c49-369b714d0403/crypt/zone/oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13" } file = sled-storage/src/manager.rs:1331
5232024-11-14T00:14:49.120ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-14T00:14:49.120ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5252024-11-14T00:14:49.233ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-14T00:14:49.233ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb" } file = sled-storage/src/manager.rs:1331
5272024-11-14T00:14:49.352ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-14T00:14:49.352ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e6e03840-7feb-4068-8c49-369b714d0403/crucible" } file = sled-storage/src/manager.rs:1331
5292024-11-14T00:14:49.465ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-11-14T00:14:49.465ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone" } file = sled-storage/src/manager.rs:1331
5312024-11-14T00:14:49.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-11-14T00:14:49.549ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a" } file = sled-storage/src/manager.rs:1331
5332024-11-14T00:14:49.609ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
5342024-11-14T00:14:49.670ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-11-14T00:14:49.670ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5362024-11-14T00:14:49.815ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-11-14T00:14:49.815ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93" } file = sled-storage/src/manager.rs:1331
5382024-11-14T00:14:49.942ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-11-14T00:14:49.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/zone/oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145"), full_name: "oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/zone/oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145" } file = sled-storage/src/manager.rs:1331
5402024-11-14T00:14:50.068ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-14T00:14:50.068ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone/oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69"), full_name: "oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone/oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69" } file = sled-storage/src/manager.rs:1331
5422024-11-14T00:14:50.191ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-14T00:14:50.191ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5442024-11-14T00:14:50.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-14T00:14:50.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/zone/oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), full_name: "oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/zone/oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a" } file = sled-storage/src/manager.rs:1331
5462024-11-14T00:14:50.435ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-11-14T00:14:50.435ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da3c518e-c769-471a-bde6-cca14456f7ec/crypt/zone/oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e"), full_name: "oxp_da3c518e-c769-471a-bde6-cca14456f7ec/crypt/zone/oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e" } file = sled-storage/src/manager.rs:1331
5482024-11-14T00:14:50.559ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-11-14T00:14:50.559ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone" } file = sled-storage/src/manager.rs:1331
5502024-11-14T00:14:50.611ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
5512024-11-14T00:14:50.644ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-11-14T00:14:50.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5532024-11-14T00:14:50.765ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-11-14T00:14:50.765ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5552024-11-14T00:14:50.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-14T00:14:50.884ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd" } file = sled-storage/src/manager.rs:1331
5572024-11-14T00:14:51.009ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-11-14T00:14:51.010ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/zone"), full_name: "oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/zone" } file = sled-storage/src/manager.rs:1331
5592024-11-14T00:14:51.102ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-11-14T00:14:51.102ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone/oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157"), full_name: "oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/zone/oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157" } file = sled-storage/src/manager.rs:1331
5612024-11-14T00:14:51.199ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5622024-11-14T00:14:51.199ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5632024-11-14T00:14:51.206ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5642024-11-14T00:14:51.206ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5652024-11-14T00:14:51.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-14T00:14:51.241ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/zone/oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4"), full_name: "oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/zone/oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4" } file = sled-storage/src/manager.rs:1331
5672024-11-14T00:14:51.357ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5682024-11-14T00:14:51.357ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5692024-11-14T00:14:51.380ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-11-14T00:14:51.380ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/zone/oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0"), full_name: "oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/zone/oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0" } file = sled-storage/src/manager.rs:1331
5712024-11-14T00:14:51.397ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
5722024-11-14T00:14:51.397ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
5732024-11-14T00:14:51.447ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
5742024-11-14T00:14:51.447ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
5752024-11-14T00:14:51.466ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
5762024-11-14T00:14:51.466ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
5772024-11-14T00:14:51.479ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17085249546186190699 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
5782024-11-14T00:14:51.479ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 682307258866166775 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
5792024-11-14T00:14:51.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-11-14T00:14:51.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/debug"), full_name: "oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/debug" } file = sled-storage/src/manager.rs:1331
5812024-11-14T00:14:51.536ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
5822024-11-14T00:14:51.536ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
5832024-11-14T00:14:51.613ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
5842024-11-14T00:14:51.619ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-14T00:14:51.620ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da3c518e-c769-471a-bde6-cca14456f7ec/crypt/debug"), full_name: "oxp_da3c518e-c769-471a-bde6-cca14456f7ec/crypt/debug" } file = sled-storage/src/manager.rs:1331
5862024-11-14T00:14:51.628ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
5872024-11-14T00:14:51.628ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5882024-11-14T00:14:51.670ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5892024-11-14T00:14:51.670ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/nexus.rs:527 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
5902024-11-14T00:14:51.708ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5912024-11-14T00:14:51.708ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
5922024-11-14T00:14:51.709ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
5932024-11-14T00:14:51.709ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5942024-11-14T00:14:51.710ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5952024-11-14T00:14:51.710ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184" } file = sled-storage/src/manager.rs:1331
5962024-11-14T00:14:51.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
5972024-11-14T00:14:51.839ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5982024-11-14T00:14:51.839ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/zone/oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c" } file = sled-storage/src/manager.rs:1331
5992024-11-14T00:14:51.971ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6002024-11-14T00:14:51.971ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crucible" } file = sled-storage/src/manager.rs:1331
6012024-11-14T00:14:52.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6022024-11-14T00:14:52.092ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6e03840-7feb-4068-8c49-369b714d0403/crypt/zone"), full_name: "oxp_e6e03840-7feb-4068-8c49-369b714d0403/crypt/zone" } file = sled-storage/src/manager.rs:1331
6032024-11-14T00:14:52.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6042024-11-14T00:14:52.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/zone"), full_name: "oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/zone" } file = sled-storage/src/manager.rs:1331
6052024-11-14T00:14:52.272ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6062024-11-14T00:14:52.272ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6072024-11-14T00:14:52.379ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
6082024-11-14T00:14:52.379ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
6092024-11-14T00:14:52.388ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6102024-11-14T00:14:52.388ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
6112024-11-14T00:14:52.510ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6122024-11-14T00:14:52.510ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/debug"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/debug" } file = sled-storage/src/manager.rs:1331
6132024-11-14T00:14:52.596ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6142024-11-14T00:14:52.596ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
6152024-11-14T00:14:52.615ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
6162024-11-14T00:14:52.712ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6172024-11-14T00:14:52.712ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b" } file = sled-storage/src/manager.rs:1331
6182024-11-14T00:14:52.839ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6192024-11-14T00:14:52.840ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone" } file = sled-storage/src/manager.rs:1331
6202024-11-14T00:14:52.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6212024-11-14T00:14:52.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da3c518e-c769-471a-bde6-cca14456f7ec/crucible" } file = sled-storage/src/manager.rs:1331
6222024-11-14T00:14:53.044ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6232024-11-14T00:14:53.044ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50"), full_name: "oxp_5d197ef6-7d58-4152-8a63-88374989a904/crypt/zone/oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50" } file = sled-storage/src/manager.rs:1331
6242024-11-14T00:14:53.176ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6252024-11-14T00:14:53.176ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6262024-11-14T00:14:53.294ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6272024-11-14T00:14:53.294ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/zone/oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3"), full_name: "oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/zone/oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3" } file = sled-storage/src/manager.rs:1331
6282024-11-14T00:14:53.423ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6292024-11-14T00:14:53.423ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12/crucible" } file = sled-storage/src/manager.rs:1331
6302024-11-14T00:14:53.545ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6312024-11-14T00:14:53.545ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777"), full_name: "oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/zone/oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777" } file = sled-storage/src/manager.rs:1331
6322024-11-14T00:14:53.617ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
6332024-11-14T00:14:53.671ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/nexus.rs:527 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
6342024-11-14T00:14:53.671ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6352024-11-14T00:14:53.672ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6362024-11-14T00:14:53.672ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6372024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6382024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6392024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6402024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6412024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6422024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6432024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6442024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6452024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6462024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6472024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6482024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6492024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6502024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6512024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6522024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6532024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6542024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6552024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6562024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6572024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6582024-11-14T00:14:53.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6592024-11-14T00:14:53.672ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
6602024-11-14T00:14:53.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7485233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41752 req_id = d9da6baf-6523-4d2a-80ee-cf6deb4ac47a response_code = 200 uri = /datasets
6612024-11-14T00:14:53.704ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 34921995-b6f6-4aad-8964-3692385af9d6 (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: af9e2ff3-0008-44dc-81fb-c799d2026305 (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6622024-11-14T00:14:53.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46367
6632024-11-14T00:14:53.704ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 34921995-b6f6-4aad-8964-3692385af9d6, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6642024-11-14T00:14:53.704ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 34921995-b6f6-4aad-8964-3692385af9d6, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652024-11-14T00:14:53.743ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6662024-11-14T00:14:53.743ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6672024-11-14T00:14:53.776ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: af9e2ff3-0008-44dc-81fb-c799d2026305, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6682024-11-14T00:14:53.776ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: af9e2ff3-0008-44dc-81fb-c799d2026305, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6692024-11-14T00:14:53.815ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6702024-11-14T00:14:53.815ZINFOSledAgent (ServiceManager): No ledger in /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:188
6712024-11-14T00:14:53.815ZINFOSledAgent (ServiceManager): No ledger in /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:188
6722024-11-14T00:14:53.815ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6732024-11-14T00:14:53.860ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6742024-11-14T00:14:53.860ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6752024-11-14T00:14:53.860ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6762024-11-14T00:14:53.914ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd file = illumos-utils/src/zone.rs:325
6772024-11-14T00:14:53.919ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6 file = illumos-utils/src/zone.rs:325
6782024-11-14T00:14:53.923ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305 file = illumos-utils/src/zone.rs:325
6792024-11-14T00:14:53.935ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd file = illumos-utils/src/zone.rs:363
6802024-11-14T00:14:53.940ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6 file = illumos-utils/src/zone.rs:363
6812024-11-14T00:14:53.944ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305 file = illumos-utils/src/zone.rs:363
6822024-11-14T00:14:54.620ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
6832024-11-14T00:14:55.472ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842024-11-14T00:14:55.472ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6852024-11-14T00:14:55.472ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
6862024-11-14T00:14:55.959ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6872024-11-14T00:14:56.437ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6882024-11-14T00:14:56.437ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6892024-11-14T00:14:56.437ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6902024-11-14T00:14:56.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 35.488151ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
6912024-11-14T00:14:56.446ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
6922024-11-14T00:14:56.450ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
6932024-11-14T00:14:56.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 133.187952ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
6942024-11-14T00:14:56.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 53.219548ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
6952024-11-14T00:14:56.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 29.23023ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
6962024-11-14T00:14:56.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 116.708438ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
6972024-11-14T00:14:56.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 131.012717ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
6982024-11-14T00:14:56.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 104.076019ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
6992024-11-14T00:14:56.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 240.831051ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
7002024-11-14T00:14:56.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 446.63835ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
7012024-11-14T00:14:56.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 135.488203ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
7022024-11-14T00:14:56.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 479.470217ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
7032024-11-14T00:14:57.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 234.648766ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
7042024-11-14T00:14:57.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 512.623959ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
7052024-11-14T00:14:57.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 489.845165ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
7062024-11-14T00:14:57.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 684.094518ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
7072024-11-14T00:14:57.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 1.411798586s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
7082024-11-14T00:14:57.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 1.062785106s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
7092024-11-14T00:14:58.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 987.280008ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
7102024-11-14T00:14:58.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 1.467260617s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
7112024-11-14T00:14:59.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 735.505398ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
7122024-11-14T00:14:59.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 635.451944ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
7132024-11-14T00:14:59.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 1.183048345s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
7142024-11-14T00:14:59.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 985.665111ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
7152024-11-14T00:15:00.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 765.98309ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
7162024-11-14T00:15:00.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd") failed: Property not found. retry in 1.157975892s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
7172024-11-14T00:15:01.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6") failed: Property not found. retry in 1.451532104s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
7182024-11-14T00:15:01.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305") failed: Property not found. retry in 1.253685447s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
7192024-11-14T00:15:01.481ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17085249546186190699 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7202024-11-14T00:15:01.481ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 682307258866166775 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7212024-11-14T00:15:02.380ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7222024-11-14T00:15:02.381ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7232024-11-14T00:15:02.492ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_1ab1c44d-7d9e-4861-bc1e-704f908d5ccd
7242024-11-14T00:15:02.492ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_34921995-b6f6-4aad-8964-3692385af9d6
7252024-11-14T00:15:02.492ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_af9e2ff3-0008-44dc-81fb-c799d2026305
7262024-11-14T00:15:02.492ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7272024-11-14T00:15:02.492ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7282024-11-14T00:15:02.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8788966 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46367 req_id = af3085a7-9e79-47bc-8125-4da3b1773a69 response_code = 204 uri = /omicron-zones
7292024-11-14T00:15:02.495ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7302024-11-14T00:15:02.537ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 147.027325ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7312024-11-14T00:15:02.703ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7322024-11-14T00:15:02.756ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7332024-11-14T00:15:02.802ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7342024-11-14T00:15:02.802ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7352024-11-14T00:15:02.832ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7362024-11-14T00:15:02.833ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7372024-11-14T00:15:02.833ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7382024-11-14T00:15:02.862ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 34921995-b6f6-4aad-8964-3692385af9d6 (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: af9e2ff3-0008-44dc-81fb-c799d2026305 (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b7dfac92-798f-4787-98fd-49c963e835d1 (service), filesystem_pool: Some(ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7d7cd0af-5829-4d17-b5ac-a78b3f4c2f59, kind: Service { id: b7dfac92-798f-4787-98fd-49c963e835d1 }, name: Name("ntp-b7dfac92-798f-4787-98fd-49c963e835d1"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 156])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7392024-11-14T00:15:02.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54977
7402024-11-14T00:15:02.862ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 34921995-b6f6-4aad-8964-3692385af9d6, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7412024-11-14T00:15:02.862ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 34921995-b6f6-4aad-8964-3692385af9d6, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7422024-11-14T00:15:02.902ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7432024-11-14T00:15:02.902ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7442024-11-14T00:15:02.939ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: af9e2ff3-0008-44dc-81fb-c799d2026305, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7452024-11-14T00:15:02.939ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: af9e2ff3-0008-44dc-81fb-c799d2026305, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7462024-11-14T00:15:02.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7472024-11-14T00:15:02.974ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
7482024-11-14T00:15:02.974ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
7492024-11-14T00:15:02.975ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7502024-11-14T00:15:02.986ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7512024-11-14T00:15:03.018ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7522024-11-14T00:15:03.019ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7532024-11-14T00:15:03.019ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7542024-11-14T00:15:03.048ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 195, 156]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7552024-11-14T00:15:03.048ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7562024-11-14T00:15:03.049ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7572024-11-14T00:15:03.049ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7582024-11-14T00:15:03.049ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7592024-11-14T00:15:03.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7602024-11-14T00:15:03.074ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1 file = illumos-utils/src/zone.rs:325
7612024-11-14T00:15:03.093ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1 file = illumos-utils/src/zone.rs:363
7622024-11-14T00:15:03.689ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7632024-11-14T00:15:03.689ZINFOSledAgent (ServiceManager): Booting oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7642024-11-14T00:15:03.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1") failed: Property not found. retry in 33.363703ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7652024-11-14T00:15:03.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1") failed: Property not found. retry in 75.582079ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7662024-11-14T00:15:03.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1") failed: Property not found. retry in 145.636183ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7672024-11-14T00:15:04.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1") failed: Property not found. retry in 360.512528ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7682024-11-14T00:15:04.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1") failed: Property not found. retry in 729.797064ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7692024-11-14T00:15:05.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1") failed: Property not found. retry in 1.176859389s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7702024-11-14T00:15:06.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1") failed: Property not found. retry in 1.398388557s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7712024-11-14T00:15:07.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1") failed: Property not found. retry in 910.245457ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7722024-11-14T00:15:08.737ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1
7732024-11-14T00:15:08.737ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7742024-11-14T00:15:08.737ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7752024-11-14T00:15:08.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5875831 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54977 req_id = baa27d87-2eca-4d96-8284-d608a20e92ef response_code = 204 uri = /omicron-zones
7762024-11-14T00:15:08.740ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7772024-11-14T00:15:08.770ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7782024-11-14T00:15:08.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49302
7792024-11-14T00:15:08.779ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7802024-11-14T00:15:08.779ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 9041 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49302 req_id = 181c2573-1c44-41c0-86db-80250feb5804 response_code = 500 uri = /timesync
7812024-11-14T00:15:08.782ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7822024-11-14T00:15:08.953ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7832024-11-14T00:15:08.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51470
7842024-11-14T00:15:11.483ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17085249546186190699 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7852024-11-14T00:15:11.484ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 682307258866166775 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7862024-11-14T00:15:12.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16867813892146101248 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7872024-11-14T00:15:12.371ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17021629301406043508 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7882024-11-14T00:15:12.381ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7892024-11-14T00:15:12.382ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7902024-11-14T00:15:12.495ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17304656717727285716 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
7912024-11-14T00:15:12.963ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7922024-11-14T00:15:12.963ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4009367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51470 req_id = 53946b35-9dc6-4c89-ba6e-fdbded6a9aea response_code = 500 uri = /timesync
7932024-11-14T00:15:12.966ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7942024-11-14T00:15:13.073ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7952024-11-14T00:15:13.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51460
7962024-11-14T00:15:13.081ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7972024-11-14T00:15:13.081ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8378 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51460 req_id = 4126b9cd-6b17-4b69-899f-ad085ad03f48 response_code = 500 uri = /timesync
7982024-11-14T00:15:13.085ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7992024-11-14T00:15:13.265ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8002024-11-14T00:15:13.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47435
8012024-11-14T00:15:16.918ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b7dfac92-798f-4787-98fd-49c963e835d1': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8022024-11-14T00:15:16.918ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47435 req_id = a73cd508-5381-42f6-9996-18db634e238c response_code = 500 uri = /timesync
8032024-11-14T00:15:16.920ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8042024-11-14T00:15:17.095ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8052024-11-14T00:15:17.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57118
8062024-11-14T00:15:17.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8684 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57118 req_id = a7cab8f2-1b21-4ee2-bf9a-c2806b331852 response_code = 200 uri = /timesync
8072024-11-14T00:15:17.107ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.381661922 } file = sled-agent/src/rack_setup/service.rs:740
8082024-11-14T00:15:17.107ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8092024-11-14T00:15:17.396ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8102024-11-14T00:15:17.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32967
8112024-11-14T00:15:17.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8796 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32967 req_id = 61a25eaa-f62b-4e86-bcef-f672da1ce555 response_code = 200 uri = /timesync
8122024-11-14T00:15:17.408ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.380844295 } file = sled-agent/src/rack_setup/service.rs:740
8132024-11-14T00:15:17.408ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8142024-11-14T00:15:17.569ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8152024-11-14T00:15:17.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38576
8162024-11-14T00:15:17.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8380 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38576 req_id = eaeef29f-3ff7-48b0-b2a3-602bd77a7013 response_code = 200 uri = /timesync
8172024-11-14T00:15:17.581ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.380376041 } file = sled-agent/src/rack_setup/service.rs:740
8182024-11-14T00:15:17.581ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8192024-11-14T00:15:18.008ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8202024-11-14T00:15:18.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44714
8212024-11-14T00:15:18.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8594 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44714 req_id = 890d30cb-2f1c-4bb0-9ec7-ec7b9601a029 response_code = 200 uri = /timesync
8222024-11-14T00:15:18.019ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.379677743 } file = sled-agent/src/rack_setup/service.rs:740
8232024-11-14T00:15:18.019ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8242024-11-14T00:15:18.353ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8252024-11-14T00:15:18.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61023
8262024-11-14T00:15:18.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61023 req_id = ded3587f-4eef-47d5-97ff-6f2b80cf2aa3 response_code = 200 uri = /timesync
8272024-11-14T00:15:18.365ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.378741264 } file = sled-agent/src/rack_setup/service.rs:740
8282024-11-14T00:15:18.365ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8292024-11-14T00:15:18.381ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3406587266102788814 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8302024-11-14T00:15:18.381ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4157785079492733010 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8312024-11-14T00:15:18.851ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8322024-11-14T00:15:18.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53822
8332024-11-14T00:15:18.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53822 req_id = 82f6eff8-32de-46b0-bd6f-33a3a14117e0 response_code = 200 uri = /timesync
8342024-11-14T00:15:18.861ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.3791731 } file = sled-agent/src/rack_setup/service.rs:740
8352024-11-14T00:15:18.861ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8362024-11-14T00:15:19.353ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 130.476318ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8372024-11-14T00:15:19.479ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8382024-11-14T00:15:19.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41761
8392024-11-14T00:15:19.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8836 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41761 req_id = 836edf11-60cc-447c-8817-d89cbb41e7ea response_code = 200 uri = /timesync
8402024-11-14T00:15:19.492ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.37746653 } file = sled-agent/src/rack_setup/service.rs:740
8412024-11-14T00:15:19.492ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8422024-11-14T00:15:20.091ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8432024-11-14T00:15:20.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54975
8442024-11-14T00:15:20.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8831 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54975 req_id = 15456de8-5c99-4596-a26a-e99363099241 response_code = 200 uri = /timesync
8452024-11-14T00:15:20.103ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.375243366 } file = sled-agent/src/rack_setup/service.rs:740
8462024-11-14T00:15:20.103ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8472024-11-14T00:15:20.695ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8482024-11-14T00:15:20.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52914
8492024-11-14T00:15:20.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8586 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52914 req_id = 78f5d0d5-db49-4326-83fc-3734184c7d3b response_code = 200 uri = /timesync
8502024-11-14T00:15:20.706ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654074, ip_addr: 129.250.35.250, stratum: 3, ref_time: 1731543319.58718, correction: -0.373307079 } file = sled-agent/src/rack_setup/service.rs:740
8512024-11-14T00:15:20.706ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8522024-11-14T00:15:21.058ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59104
8532024-11-14T00:15:21.058ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59104 req_id = 2193faaa-0daf-44fb-922c-12ac0fd802eb response_code = 200 uri = /baseboard
8542024-11-14T00:15:21.118ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17085249546186190699 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8552024-11-14T00:15:21.118ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 682307258866166775 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8562024-11-14T00:15:21.302ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8572024-11-14T00:15:21.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32857
8582024-11-14T00:15:21.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8814 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32857 req_id = ce08c6a7-a299-431a-95b3-b19ce0a4e7fe response_code = 200 uri = /timesync
8592024-11-14T00:15:21.315ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654074, ip_addr: 129.250.35.250, stratum: 3, ref_time: 1731543319.58718, correction: -0.371657848 } file = sled-agent/src/rack_setup/service.rs:740
8602024-11-14T00:15:21.315ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8612024-11-14T00:15:21.735ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16867813892146101248 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8622024-11-14T00:15:22.003ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17021629301406043508 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8632024-11-14T00:15:22.013ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8642024-11-14T00:15:22.013ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8652024-11-14T00:15:22.126ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17304656717727285716 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8662024-11-14T00:15:22.607ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8672024-11-14T00:15:22.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35310
8682024-11-14T00:15:22.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8719 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35310 req_id = d58285c2-0ab1-49dd-b2ba-5a55ca053597 response_code = 200 uri = /timesync
8692024-11-14T00:15:22.618ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543321.1433215, correction: -0.368313462 } file = sled-agent/src/rack_setup/service.rs:740
8702024-11-14T00:15:22.618ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8712024-11-14T00:15:24.143ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8722024-11-14T00:15:24.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42625
8732024-11-14T00:15:24.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42625 req_id = ed8da3d7-4dc6-4c0c-9959-35ca2e9966ae response_code = 200 uri = /timesync
8742024-11-14T00:15:24.153ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543322.937569, correction: -0.363821238 } file = sled-agent/src/rack_setup/service.rs:740
8752024-11-14T00:15:24.153ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8762024-11-14T00:15:25.307ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8772024-11-14T00:15:25.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60576
8782024-11-14T00:15:25.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60576 req_id = 3d0c7ef6-ea9c-42bd-9215-a52e765377be response_code = 200 uri = /timesync
8792024-11-14T00:15:25.319ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543324.7304072, correction: -0.360639453 } file = sled-agent/src/rack_setup/service.rs:740
8802024-11-14T00:15:25.319ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8812024-11-14T00:15:27.557ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8822024-11-14T00:15:27.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45963
8832024-11-14T00:15:27.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9479 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45963 req_id = 17cfaf25-ca92-49dc-8d60-8cf435bf3b7e response_code = 200 uri = /timesync
8842024-11-14T00:15:27.572ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543326.0805886, correction: -0.354319125 } file = sled-agent/src/rack_setup/service.rs:740
8852024-11-14T00:15:27.572ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8862024-11-14T00:15:28.356ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3406587266102788814 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8872024-11-14T00:15:28.356ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4157785079492733010 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8882024-11-14T00:15:29.580ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8892024-11-14T00:15:29.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49094
8902024-11-14T00:15:29.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49094 req_id = ddcd0b37-4121-4ff3-a31d-d3ea5bf84818 response_code = 200 uri = /timesync
8912024-11-14T00:15:29.593ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543327.9938717, correction: -0.348875552 } file = sled-agent/src/rack_setup/service.rs:740
8922024-11-14T00:15:29.593ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8932024-11-14T00:15:31.093ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17085249546186190699 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8942024-11-14T00:15:31.093ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 682307258866166775 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8952024-11-14T00:15:31.710ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16867813892146101248 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8962024-11-14T00:15:31.976ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17021629301406043508 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8972024-11-14T00:15:31.987ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8982024-11-14T00:15:31.987ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
8992024-11-14T00:15:32.100ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17304656717727285716 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9002024-11-14T00:15:33.461ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9012024-11-14T00:15:33.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50682
9022024-11-14T00:15:33.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50682 req_id = 1b9174d4-2cf1-488b-980f-27d88538dd37 response_code = 200 uri = /timesync
9032024-11-14T00:15:33.474ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543332.699752, correction: -0.3384341 } file = sled-agent/src/rack_setup/service.rs:740
9042024-11-14T00:15:33.474ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9052024-11-14T00:15:34.479ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 608.07281ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9062024-11-14T00:15:35.256ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9072024-11-14T00:15:35.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58374
9082024-11-14T00:15:35.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58374 req_id = 1bce531b-c2f8-49d4-b03b-6dcd59c8d158 response_code = 200 uri = /timesync
9092024-11-14T00:15:35.268ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543334.2823644, correction: -0.33354339 } file = sled-agent/src/rack_setup/service.rs:740
9102024-11-14T00:15:35.268ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9112024-11-14T00:15:37.495ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9122024-11-14T00:15:37.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56504
9132024-11-14T00:15:37.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8411 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56504 req_id = 7b84751a-efdc-45bb-9147-477aee69d509 response_code = 200 uri = /timesync
9142024-11-14T00:15:37.507ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543336.621675, correction: -0.327483088 } file = sled-agent/src/rack_setup/service.rs:740
9152024-11-14T00:15:37.507ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9162024-11-14T00:15:38.332ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3406587266102788814 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9172024-11-14T00:15:38.332ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4157785079492733010 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9182024-11-14T00:15:41.068ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17085249546186190699 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9192024-11-14T00:15:41.068ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 682307258866166775 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9202024-11-14T00:15:41.684ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16867813892146101248 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9212024-11-14T00:15:41.950ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17021629301406043508 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9222024-11-14T00:15:41.961ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9232024-11-14T00:15:41.961ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9242024-11-14T00:15:42.075ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17304656717727285716 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9252024-11-14T00:15:43.404ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9262024-11-14T00:15:43.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65478
9272024-11-14T00:15:43.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65478 req_id = e341189b-0d33-43c5-bb5b-ad7d245fb68a response_code = 200 uri = /timesync
9282024-11-14T00:15:43.417ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543340.2635984, correction: -0.311430305 } file = sled-agent/src/rack_setup/service.rs:740
9292024-11-14T00:15:43.417ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9302024-11-14T00:15:48.230ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9312024-11-14T00:15:48.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37215
9322024-11-14T00:15:48.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8583 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37215 req_id = f4400117-32b7-4776-8e52-c9a501bcf0ab response_code = 200 uri = /timesync
9332024-11-14T00:15:48.241ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543344.1244912, correction: -0.298473626 } file = sled-agent/src/rack_setup/service.rs:740
9342024-11-14T00:15:48.241ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9352024-11-14T00:15:48.308ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3406587266102788814 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9362024-11-14T00:15:48.308ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4157785079492733010 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9372024-11-14T00:15:50.080ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 796.814685ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9382024-11-14T00:15:51.013ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34114
9392024-11-14T00:15:51.013ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34114 req_id = 1a9d1fdc-ff4d-44b1-9b46-dd021777e006 response_code = 200 uri = /baseboard
9402024-11-14T00:15:51.042ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17085249546186190699 reason = Duration(60s) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9412024-11-14T00:15:51.043ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 682307258866166775 reason = Duration(60s) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9422024-11-14T00:15:51.660ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16867813892146101248 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9432024-11-14T00:15:51.925ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17021629301406043508 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9442024-11-14T00:15:51.935ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9452024-11-14T00:15:51.935ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9462024-11-14T00:15:52.050ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17304656717727285716 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9472024-11-14T00:15:52.224ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9482024-11-14T00:15:52.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33670
9492024-11-14T00:15:52.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33670 req_id = c13cf91c-e102-4fde-a1c1-ee706aca3de7 response_code = 200 uri = /timesync
9502024-11-14T00:15:52.236ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543348.2350953, correction: -0.287667185 } file = sled-agent/src/rack_setup/service.rs:740
9512024-11-14T00:15:52.236ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9522024-11-14T00:15:58.283ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3406587266102788814 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9532024-11-14T00:15:58.283ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4157785079492733010 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9542024-11-14T00:16:01.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16867813892146101248 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9552024-11-14T00:16:01.900ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17021629301406043508 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9562024-11-14T00:16:01.909ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9572024-11-14T00:16:01.909ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9582024-11-14T00:16:02.024ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17304656717727285716 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9592024-11-14T00:16:03.464ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9602024-11-14T00:16:03.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61134
9612024-11-14T00:16:03.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8755 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61134 req_id = 82fb02e1-f169-4835-98a6-8ec4e8e33f4d response_code = 200 uri = /timesync
9622024-11-14T00:16:03.476ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543356.9857578, correction: -0.256905496 } file = sled-agent/src/rack_setup/service.rs:740
9632024-11-14T00:16:03.476ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9642024-11-14T00:16:05.868ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.870963082s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9652024-11-14T00:16:08.258ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3406587266102788814 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9662024-11-14T00:16:08.258ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4157785079492733010 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9672024-11-14T00:16:11.610ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16867813892146101248 reason = Duration(60s) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9682024-11-14T00:16:11.875ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17021629301406043508 reason = Duration(60s) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9692024-11-14T00:16:11.883ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9702024-11-14T00:16:11.883ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9712024-11-14T00:16:11.998ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17304656717727285716 reason = Duration(60s) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9722024-11-14T00:16:16.684ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9732024-11-14T00:16:16.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43673
9742024-11-14T00:16:16.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8795 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43673 req_id = 3c7fe5d2-9131-49dc-aa4e-6dd2c84090ff response_code = 200 uri = /timesync
9752024-11-14T00:16:16.696ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543373.0008905, correction: -0.220978752 } file = sled-agent/src/rack_setup/service.rs:740
9762024-11-14T00:16:16.696ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9772024-11-14T00:16:18.234ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3406587266102788814 reason = Duration(60s) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9782024-11-14T00:16:18.234ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4157785079492733010 reason = Duration(60s) sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9792024-11-14T00:16:20.966ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52428
9802024-11-14T00:16:20.966ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52428 req_id = 1567a717-2a95-4ae4-94a0-9c1a58d096ba response_code = 200 uri = /baseboard
9812024-11-14T00:16:21.858ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9822024-11-14T00:16:21.858ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9832024-11-14T00:16:23.726ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.091289268s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9842024-11-14T00:16:30.505ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9852024-11-14T00:16:30.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44735
9862024-11-14T00:16:30.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8965 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44735 req_id = fe7f6608-8c76-425e-9a3f-0df06bb60be8 response_code = 200 uri = /timesync
9872024-11-14T00:16:30.518ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1731543389.081776, correction: -0.183426142 } file = sled-agent/src/rack_setup/service.rs:740
9882024-11-14T00:16:30.518ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9892024-11-14T00:16:31.833ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9902024-11-14T00:16:31.834ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9912024-11-14T00:16:41.380ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9922024-11-14T00:16:41.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59709
9932024-11-14T00:16:41.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8892 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 2cdbfdd2-ddd0-43b5-b67d-2a96dc518562 response_code = 200 uri = /timesync
9942024-11-14T00:16:41.392ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1731543400.6920822, correction: -0.153938845 } file = sled-agent/src/rack_setup/service.rs:740
9952024-11-14T00:16:41.392ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9962024-11-14T00:16:41.804ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.693321994s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9972024-11-14T00:16:41.809ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9982024-11-14T00:16:41.809ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
9992024-11-14T00:16:50.917ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63605
10002024-11-14T00:16:50.917ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63605 req_id = 8bc42539-875a-430c-9ffb-65049049f669 response_code = 200 uri = /baseboard
10012024-11-14T00:16:51.784ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10022024-11-14T00:16:51.784ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10032024-11-14T00:17:00.289ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10042024-11-14T00:17:00.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58365
10052024-11-14T00:17:00.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58365 req_id = 710cedb1-6ddf-4ff6-b904-333fe4bc7288 response_code = 200 uri = /timesync
10062024-11-14T00:17:00.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1731543418.6009555, correction: -0.102598377 } file = sled-agent/src/rack_setup/service.rs:740
10072024-11-14T00:17:00.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10082024-11-14T00:17:01.759ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10092024-11-14T00:17:01.759ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10102024-11-14T00:17:08.459ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 15.866732991s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10112024-11-14T00:17:11.734ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10122024-11-14T00:17:11.734ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10132024-11-14T00:17:20.873ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34658
10142024-11-14T00:17:20.873ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34658 req_id = 6a32397a-8ed0-4fc0-b77c-97001ca67543 response_code = 200 uri = /baseboard
10152024-11-14T00:17:21.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13727755835140388377 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10162024-11-14T00:17:21.710ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4251166361666308179 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10172024-11-14T00:17:24.049ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10182024-11-14T00:17:24.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59244
10192024-11-14T00:17:24.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22603 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59244 req_id = 62eafed3-5323-4a9f-b6bd-831d5d952928 response_code = 200 uri = /timesync
10202024-11-14T00:17:24.072ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T00:15:51.042920115Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17085249546186190699 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10212024-11-14T00:17:24.073ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T00:16:18.234083943Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3406587266102788814 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10222024-11-14T00:17:24.074ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T00:15:51.043498303Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 682307258866166775 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10232024-11-14T00:17:24.074ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T00:16:18.234435218Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4157785079492733010 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10242024-11-14T00:17:24.074ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T00:16:11.998675091Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17304656717727285716 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10252024-11-14T00:17:24.074ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T00:16:11.610516984Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16867813892146101248 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10262024-11-14T00:17:24.075ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T00:16:11.875318501Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17021629301406043508 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
10272024-11-14T00:17:24.077ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1731543443.4529295, correction: -0.038028959 } file = sled-agent/src/rack_setup/service.rs:740
10282024-11-14T00:17:24.077ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1423
10292024-11-14T00:17:24.108ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 34921995-b6f6-4aad-8964-3692385af9d6 (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: af9e2ff3-0008-44dc-81fb-c799d2026305 (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b7dfac92-798f-4787-98fd-49c963e835d1 (service), filesystem_pool: Some(ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7d7cd0af-5829-4d17-b5ac-a78b3f4c2f59, kind: Service { id: b7dfac92-798f-4787-98fd-49c963e835d1 }, name: Name("ntp-b7dfac92-798f-4787-98fd-49c963e835d1"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 156])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: cd52fed5-ca1e-4a29-bbb1-0f66f063f71d (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: b958716e-ab0d-47ba-bf10-952b59a2ca50 (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } } } }, OmicronZoneConfig { id: 574e8d5e-f1d4-47c3-a841-a6074b38f777 (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7cf28221-34cf-4956-9e1a-5bcdabd0db69 (service), filesystem_pool: Some(ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External } } } }, OmicronZoneConfig { id: 2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01 (service), filesystem_pool: Some(ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10302024-11-14T00:17:24.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50552
10312024-11-14T00:17:24.108ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 34921995-b6f6-4aad-8964-3692385af9d6, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10322024-11-14T00:17:24.108ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 34921995-b6f6-4aad-8964-3692385af9d6, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10332024-11-14T00:17:24.143ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10342024-11-14T00:17:24.143ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10352024-11-14T00:17:24.174ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: af9e2ff3-0008-44dc-81fb-c799d2026305, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10362024-11-14T00:17:24.174ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: af9e2ff3-0008-44dc-81fb-c799d2026305, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10372024-11-14T00:17:24.204ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cd52fed5-ca1e-4a29-bbb1-0f66f063f71d, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10382024-11-14T00:17:24.204ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cd52fed5-ca1e-4a29-bbb1-0f66f063f71d, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10392024-11-14T00:17:24.237ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b958716e-ab0d-47ba-bf10-952b59a2ca50, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10402024-11-14T00:17:24.237ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b958716e-ab0d-47ba-bf10-952b59a2ca50, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10412024-11-14T00:17:24.269ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 574e8d5e-f1d4-47c3-a841-a6074b38f777, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10422024-11-14T00:17:24.269ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 574e8d5e-f1d4-47c3-a841-a6074b38f777, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10432024-11-14T00:17:24.301ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7cf28221-34cf-4956-9e1a-5bcdabd0db69, dataset_name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10442024-11-14T00:17:24.302ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7cf28221-34cf-4956-9e1a-5bcdabd0db69, dataset_name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452024-11-14T00:17:24.338ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01, dataset_name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10462024-11-14T00:17:24.338ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01, dataset_name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472024-11-14T00:17:24.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10482024-11-14T00:17:24.370ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
10492024-11-14T00:17:24.370ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
10502024-11-14T00:17:24.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10512024-11-14T00:17:24.453ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10522024-11-14T00:17:24.453ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10532024-11-14T00:17:24.453ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10542024-11-14T00:17:24.453ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10552024-11-14T00:17:24.453ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10562024-11-14T00:17:24.547ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d file = illumos-utils/src/zone.rs:325
10572024-11-14T00:17:24.551ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777 file = illumos-utils/src/zone.rs:325
10582024-11-14T00:17:24.555ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69 file = illumos-utils/src/zone.rs:325
10592024-11-14T00:17:24.560ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50 file = illumos-utils/src/zone.rs:325
10602024-11-14T00:17:24.564ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01 file = illumos-utils/src/zone.rs:325
10612024-11-14T00:17:24.569ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d file = illumos-utils/src/zone.rs:363
10622024-11-14T00:17:24.573ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777 file = illumos-utils/src/zone.rs:363
10632024-11-14T00:17:24.577ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69 file = illumos-utils/src/zone.rs:363
10642024-11-14T00:17:24.581ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50 file = illumos-utils/src/zone.rs:363
10652024-11-14T00:17:24.586ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01 file = illumos-utils/src/zone.rs:363
10662024-11-14T00:17:27.557ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cd52fed5-ca1e-4a29-bbb1-0f66f063f71d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10672024-11-14T00:17:27.557ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
10682024-11-14T00:17:27.590ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7cf28221-34cf-4956-9e1a-5bcdabd0db69'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10692024-11-14T00:17:27.590ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='574e8d5e-f1d4-47c3-a841-a6074b38f777'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10702024-11-14T00:17:27.590ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
10712024-11-14T00:17:27.596ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
10722024-11-14T00:17:27.607ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10732024-11-14T00:17:27.607ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
10742024-11-14T00:17:27.651ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b958716e-ab0d-47ba-bf10-952b59a2ca50'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10752024-11-14T00:17:27.651ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
10762024-11-14T00:17:27.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 47.268714ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
10772024-11-14T00:17:27.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 71.632222ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
10782024-11-14T00:17:27.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 52.062299ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
10792024-11-14T00:17:27.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 26.162231ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
10802024-11-14T00:17:27.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 85.717609ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
10812024-11-14T00:17:27.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 88.702736ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
10822024-11-14T00:17:28.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 109.325776ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
10832024-11-14T00:17:28.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 141.29918ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
10842024-11-14T00:17:28.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 86.505468ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
10852024-11-14T00:17:29.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 55.240927ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
10862024-11-14T00:17:30.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 271.533881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
10872024-11-14T00:17:30.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 283.950047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
10882024-11-14T00:17:30.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 291.258812ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
10892024-11-14T00:17:30.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 115.118371ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
10902024-11-14T00:17:30.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 95.791289ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
10912024-11-14T00:17:30.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 443.923576ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
10922024-11-14T00:17:30.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 234.475521ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
10932024-11-14T00:17:30.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 592.803435ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
10942024-11-14T00:17:30.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 436.806434ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
10952024-11-14T00:17:30.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 476.504778ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
10962024-11-14T00:17:30.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 504.357145ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
10972024-11-14T00:17:30.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 1.068993903s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
10982024-11-14T00:17:31.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 756.550281ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
10992024-11-14T00:17:31.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 899.626694ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11002024-11-14T00:17:31.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 786.022072ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11012024-11-14T00:17:31.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 552.096921ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11022024-11-14T00:17:31.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 728.984649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11032024-11-14T00:17:31.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 1.263252348s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11042024-11-14T00:17:31.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 1.069179868s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11052024-11-14T00:17:31.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 801.604455ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11062024-11-14T00:17:31.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 948.697165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11072024-11-14T00:17:32.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 1.070419006s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11082024-11-14T00:17:32.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 1.317036774s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11092024-11-14T00:17:32.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 553.54228ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11102024-11-14T00:17:33.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 918.179725ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11112024-11-14T00:17:33.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 809.936627ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11122024-11-14T00:17:33.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 738.982585ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11132024-11-14T00:17:33.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 932.315919ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11142024-11-14T00:17:33.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 799.717483ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11152024-11-14T00:17:33.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 1.499163582s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11162024-11-14T00:17:34.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 845.064649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11172024-11-14T00:17:34.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 886.770583ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11182024-11-14T00:17:34.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 1.256776652s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11192024-11-14T00:17:34.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 718.0984ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11202024-11-14T00:17:34.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 1.365182485s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11212024-11-14T00:17:35.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 665.425397ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11222024-11-14T00:17:35.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 990.144528ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11232024-11-14T00:17:35.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 973.786109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11242024-11-14T00:17:35.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 618.915218ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11252024-11-14T00:17:35.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 619.452341ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11262024-11-14T00:17:36.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 1.492222736s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11272024-11-14T00:17:36.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 807.431932ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11282024-11-14T00:17:36.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 1.052260967s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11292024-11-14T00:17:36.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 1.046114998s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11302024-11-14T00:17:36.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 980.510981ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11312024-11-14T00:17:37.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 846.564656ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11322024-11-14T00:17:37.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 962.945994ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11332024-11-14T00:17:37.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 1.116275642s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11342024-11-14T00:17:37.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 1.447458024s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11352024-11-14T00:17:37.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 531.861885ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11362024-11-14T00:17:38.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 1.162279409s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11372024-11-14T00:17:38.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 1.066006402s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11382024-11-14T00:17:38.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 535.848136ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11392024-11-14T00:17:38.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50") failed: Property not found. retry in 1.432740559s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11402024-11-14T00:17:38.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 738.60549ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11412024-11-14T00:17:38.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 650.617943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11422024-11-14T00:17:39.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01") failed: Property not found. retry in 1.37151379s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11432024-11-14T00:17:39.299ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 23.375319745s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
11442024-11-14T00:17:39.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69") failed: Property not found. retry in 1.29116387s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11452024-11-14T00:17:39.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 1.441726823s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11462024-11-14T00:17:39.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d") failed: Property not found. retry in 1.390209794s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11472024-11-14T00:17:41.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 710.552084ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11482024-11-14T00:17:41.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 951.652377ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11492024-11-14T00:17:42.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 907.091674ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11502024-11-14T00:17:43.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 1.006287694s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11512024-11-14T00:17:44.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 1.168952891s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11522024-11-14T00:17:46.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 1.1432289s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11532024-11-14T00:17:47.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 692.19467ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11542024-11-14T00:17:48.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 776.709236ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11552024-11-14T00:17:48.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 654.105026ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11562024-11-14T00:17:49.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777") failed: Property not found. retry in 1.202285395s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11572024-11-14T00:17:50.790ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_cd52fed5-ca1e-4a29-bbb1-0f66f063f71d
11582024-11-14T00:17:50.790ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_574e8d5e-f1d4-47c3-a841-a6074b38f777
11592024-11-14T00:17:50.790ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_7cf28221-34cf-4956-9e1a-5bcdabd0db69
11602024-11-14T00:17:50.790ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_b958716e-ab0d-47ba-bf10-952b59a2ca50
11612024-11-14T00:17:50.790ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01
11622024-11-14T00:17:50.790ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11632024-11-14T00:17:50.842ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11642024-11-14T00:17:50.861ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35840
11652024-11-14T00:17:50.861ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35840 req_id = 115db60a-a093-4e74-b8e9-e3caf7dc3a4a response_code = 200 uri = /baseboard
11662024-11-14T00:17:50.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26917916 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50552 req_id = 57e14139-e4f3-4ff4-bdd2-c43633dfff96 response_code = 204 uri = /omicron-zones
11672024-11-14T00:17:51.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36313
11682024-11-14T00:17:51.288ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3743
11692024-11-14T00:17:56.495ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11702024-11-14T00:18:10.397ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11712024-11-14T00:18:10.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19373461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36313 req_id = e4de75ab-304a-496f-8653-8dad07082468 response_code = 204 uri = /cockroachdb
11722024-11-14T00:18:10.461ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 34921995-b6f6-4aad-8964-3692385af9d6 (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: af9e2ff3-0008-44dc-81fb-c799d2026305 (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b7dfac92-798f-4787-98fd-49c963e835d1 (service), filesystem_pool: Some(ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7d7cd0af-5829-4d17-b5ac-a78b3f4c2f59, kind: Service { id: b7dfac92-798f-4787-98fd-49c963e835d1 }, name: Name("ntp-b7dfac92-798f-4787-98fd-49c963e835d1"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 156])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: cd52fed5-ca1e-4a29-bbb1-0f66f063f71d (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: b958716e-ab0d-47ba-bf10-952b59a2ca50 (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } } } }, OmicronZoneConfig { id: 574e8d5e-f1d4-47c3-a841-a6074b38f777 (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7cf28221-34cf-4956-9e1a-5bcdabd0db69 (service), filesystem_pool: Some(ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External } } } }, OmicronZoneConfig { id: 2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01 (service), filesystem_pool: Some(ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External } } } }, OmicronZoneConfig { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: b501ed1c-871c-451e-b97c-1d88e152ca13 (service), filesystem_pool: Some(ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a (service), filesystem_pool: Some(ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d06da591-b39e-4924-be5a-46bd48b9952b (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ad042fde-503a-4314-8c8c-afa2f783d145 (service), filesystem_pool: Some(ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: d671b8e1-b507-4777-9196-b14d5f25fd93 (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3e82f96f-8255-41a3-bd38-1deecfd537a0 (service), filesystem_pool: Some(ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 91fec770-b0c9-4024-b18f-060e66c7615e (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c (service), filesystem_pool: Some(ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: df1760d7-ef0e-4186-8196-958d7090b69a (service), filesystem_pool: Some(ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External } } } }, OmicronZoneConfig { id: ff5ba4ab-19ec-4089-86e3-65a9903e98eb (service), filesystem_pool: Some(ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External } } } }, OmicronZoneConfig { id: b2a35788-883a-4af6-8781-03b47e51c157 (service), filesystem_pool: Some(ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External } } } }, OmicronZoneConfig { id: 1cc5aabb-5fa0-4a35-8abc-1a785efd506e (service), filesystem_pool: Some(ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External } } } }, OmicronZoneConfig { id: 8d6a1d55-57dc-42aa-8004-81f26f56cbb2 (service), filesystem_pool: Some(ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External } } } }, OmicronZoneConfig { id: 211f63fe-3256-4889-92da-e44182f6d93f (service), filesystem_pool: Some(ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External } } } }, OmicronZoneConfig { id: 11aeeaea-9ff6-414f-9c46-5ea13e8786b3 (service), filesystem_pool: Some(ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External } } } }, OmicronZoneConfig { id: 800ba40d-d75b-43c3-938f-70c63a5ef6b4 (service), filesystem_pool: Some(ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11732024-11-14T00:18:10.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42432
11742024-11-14T00:18:10.462ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 34921995-b6f6-4aad-8964-3692385af9d6, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11752024-11-14T00:18:10.462ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 34921995-b6f6-4aad-8964-3692385af9d6, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11762024-11-14T00:18:10.520ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11772024-11-14T00:18:10.520ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1ab1c44d-7d9e-4861-bc1e-704f908d5ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11782024-11-14T00:18:10.580ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: af9e2ff3-0008-44dc-81fb-c799d2026305, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11792024-11-14T00:18:10.580ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: af9e2ff3-0008-44dc-81fb-c799d2026305, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11802024-11-14T00:18:10.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cd52fed5-ca1e-4a29-bbb1-0f66f063f71d, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11812024-11-14T00:18:10.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cd52fed5-ca1e-4a29-bbb1-0f66f063f71d, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11822024-11-14T00:18:10.708ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b958716e-ab0d-47ba-bf10-952b59a2ca50, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11832024-11-14T00:18:10.708ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b958716e-ab0d-47ba-bf10-952b59a2ca50, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11842024-11-14T00:18:10.777ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 574e8d5e-f1d4-47c3-a841-a6074b38f777, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11852024-11-14T00:18:10.777ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 574e8d5e-f1d4-47c3-a841-a6074b38f777, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11862024-11-14T00:18:10.827ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7cf28221-34cf-4956-9e1a-5bcdabd0db69, dataset_name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11872024-11-14T00:18:10.827ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7cf28221-34cf-4956-9e1a-5bcdabd0db69, dataset_name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Cockroach }, responder: ... }
11882024-11-14T00:18:10.903ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01, dataset_name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11892024-11-14T00:18:10.903ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2c470ae3-fd27-4f7f-a9f6-c4c74ef00e01, dataset_name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Cockroach }, responder: ... }
11902024-11-14T00:18:10.982ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11912024-11-14T00:18:10.982ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11922024-11-14T00:18:11.046ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: df51b222-8234-4074-91c0-cdaaebfaa9a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11932024-11-14T00:18:11.046ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: df51b222-8234-4074-91c0-cdaaebfaa9a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11942024-11-14T00:18:11.313ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d671b8e1-b507-4777-9196-b14d5f25fd93, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
11952024-11-14T00:18:11.313ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d671b8e1-b507-4777-9196-b14d5f25fd93, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11962024-11-14T00:18:11.385ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11972024-11-14T00:18:11.385ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c, dataset_name: DatasetName { pool_name: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, kind: Crucible }, responder: ... }
11982024-11-14T00:18:11.463ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: df1760d7-ef0e-4186-8196-958d7090b69a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11992024-11-14T00:18:11.463ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: df1760d7-ef0e-4186-8196-958d7090b69a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, kind: Crucible }, responder: ... }
12002024-11-14T00:18:11.519ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff5ba4ab-19ec-4089-86e3-65a9903e98eb, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12012024-11-14T00:18:11.519ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff5ba4ab-19ec-4089-86e3-65a9903e98eb, dataset_name: DatasetName { pool_name: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, kind: Crucible }, responder: ... }
12022024-11-14T00:18:11.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b2a35788-883a-4af6-8781-03b47e51c157, dataset_name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12032024-11-14T00:18:11.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b2a35788-883a-4af6-8781-03b47e51c157, dataset_name: DatasetName { pool_name: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, kind: Crucible }, responder: ... }
12042024-11-14T00:18:11.654ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1cc5aabb-5fa0-4a35-8abc-1a785efd506e, dataset_name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12052024-11-14T00:18:11.654ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1cc5aabb-5fa0-4a35-8abc-1a785efd506e, dataset_name: DatasetName { pool_name: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, kind: Crucible }, responder: ... }
12062024-11-14T00:18:11.708ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d6a1d55-57dc-42aa-8004-81f26f56cbb2, dataset_name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12072024-11-14T00:18:11.708ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8d6a1d55-57dc-42aa-8004-81f26f56cbb2, dataset_name: DatasetName { pool_name: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, kind: Crucible }, responder: ... }
12082024-11-14T00:18:11.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 211f63fe-3256-4889-92da-e44182f6d93f, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12092024-11-14T00:18:11.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 211f63fe-3256-4889-92da-e44182f6d93f, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, kind: Crucible }, responder: ... }
12102024-11-14T00:18:11.848ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 11aeeaea-9ff6-414f-9c46-5ea13e8786b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12112024-11-14T00:18:11.848ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 11aeeaea-9ff6-414f-9c46-5ea13e8786b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, kind: Crucible }, responder: ... }
12122024-11-14T00:18:11.918ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 800ba40d-d75b-43c3-938f-70c63a5ef6b4, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12132024-11-14T00:18:11.918ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 800ba40d-d75b-43c3-938f-70c63a5ef6b4, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, kind: Crucible }, responder: ... }
12142024-11-14T00:18:11.996ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12152024-11-14T00:18:11.996ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
12162024-11-14T00:18:11.997ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
12172024-11-14T00:18:11.997ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12182024-11-14T00:18:12.144ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12192024-11-14T00:18:12.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12202024-11-14T00:18:12.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12212024-11-14T00:18:12.177ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12222024-11-14T00:18:12.178ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12232024-11-14T00:18:12.178ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12242024-11-14T00:18:12.179ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12252024-11-14T00:18:12.191ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12262024-11-14T00:18:12.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12272024-11-14T00:18:12.193ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12282024-11-14T00:18:12.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12292024-11-14T00:18:12.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12302024-11-14T00:18:12.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12312024-11-14T00:18:12.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12322024-11-14T00:18:12.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12332024-11-14T00:18:12.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12342024-11-14T00:18:12.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12352024-11-14T00:18:12.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12362024-11-14T00:18:12.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12372024-11-14T00:18:12.371ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb file = illumos-utils/src/zone.rs:325
12382024-11-14T00:18:12.376ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e file = illumos-utils/src/zone.rs:325
12392024-11-14T00:18:12.381ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3 file = illumos-utils/src/zone.rs:325
12402024-11-14T00:18:12.386ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157 file = illumos-utils/src/zone.rs:325
12412024-11-14T00:18:12.391ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c file = illumos-utils/src/zone.rs:325
12422024-11-14T00:18:12.396ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e file = illumos-utils/src/zone.rs:325
12432024-11-14T00:18:12.554ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb file = illumos-utils/src/zone.rs:363
12442024-11-14T00:18:12.558ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e file = illumos-utils/src/zone.rs:363
12452024-11-14T00:18:12.563ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3 file = illumos-utils/src/zone.rs:363
12462024-11-14T00:18:12.567ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157 file = illumos-utils/src/zone.rs:363
12472024-11-14T00:18:12.571ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c file = illumos-utils/src/zone.rs:363
12482024-11-14T00:18:12.576ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e file = illumos-utils/src/zone.rs:363
12492024-11-14T00:18:12.581ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a file = illumos-utils/src/zone.rs:325
12502024-11-14T00:18:12.585ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0 file = illumos-utils/src/zone.rs:325
12512024-11-14T00:18:12.591ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2 file = illumos-utils/src/zone.rs:325
12522024-11-14T00:18:12.596ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d file = illumos-utils/src/zone.rs:325
12532024-11-14T00:18:12.601ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f file = illumos-utils/src/zone.rs:325
12542024-11-14T00:18:12.606ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93 file = illumos-utils/src/zone.rs:325
12552024-11-14T00:18:12.612ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4 file = illumos-utils/src/zone.rs:325
12562024-11-14T00:18:12.617ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145 file = illumos-utils/src/zone.rs:325
12572024-11-14T00:18:12.623ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a file = illumos-utils/src/zone.rs:363
12582024-11-14T00:18:12.630ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0 file = illumos-utils/src/zone.rs:363
12592024-11-14T00:18:12.637ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2 file = illumos-utils/src/zone.rs:363
12602024-11-14T00:18:12.643ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d file = illumos-utils/src/zone.rs:363
12612024-11-14T00:18:12.650ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f file = illumos-utils/src/zone.rs:363
12622024-11-14T00:18:12.656ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93 file = illumos-utils/src/zone.rs:363
12632024-11-14T00:18:12.663ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4 file = illumos-utils/src/zone.rs:363
12642024-11-14T00:18:12.670ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145 file = illumos-utils/src/zone.rs:363
12652024-11-14T00:18:12.738ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12662024-11-14T00:18:12.803ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12672024-11-14T00:18:12.870ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12682024-11-14T00:18:12.932ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12692024-11-14T00:18:12.990ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12702024-11-14T00:18:12.992ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12712024-11-14T00:18:12.992ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12722024-11-14T00:18:13.049ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 210, 143]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12732024-11-14T00:18:13.049ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12742024-11-14T00:18:13.051ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12752024-11-14T00:18:13.051ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12762024-11-14T00:18:13.107ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 231, 88]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12772024-11-14T00:18:13.107ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12782024-11-14T00:18:13.108ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12792024-11-14T00:18:13.108ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12802024-11-14T00:18:13.162ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 130, 250]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12812024-11-14T00:18:13.162ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12822024-11-14T00:18:13.163ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12832024-11-14T00:18:13.163ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12842024-11-14T00:18:13.218ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 240, 202]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12852024-11-14T00:18:13.218ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12862024-11-14T00:18:13.220ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12872024-11-14T00:18:13.220ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12882024-11-14T00:18:13.276ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 181, 46]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12892024-11-14T00:18:13.276ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12902024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12912024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12922024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12932024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12942024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12952024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12962024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12972024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12982024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12992024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13002024-11-14T00:18:13.281ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13012024-11-14T00:18:13.282ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13022024-11-14T00:18:13.335ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13032024-11-14T00:18:13.340ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13042024-11-14T00:18:13.344ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13052024-11-14T00:18:13.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13062024-11-14T00:18:13.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13072024-11-14T00:18:13.347ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13082024-11-14T00:18:13.350ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13092024-11-14T00:18:13.350ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13102024-11-14T00:18:13.560ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a file = illumos-utils/src/zone.rs:325
13112024-11-14T00:18:13.567ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4 file = illumos-utils/src/zone.rs:325
13122024-11-14T00:18:13.572ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184 file = illumos-utils/src/zone.rs:325
13132024-11-14T00:18:13.578ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13 file = illumos-utils/src/zone.rs:325
13142024-11-14T00:18:13.584ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b file = illumos-utils/src/zone.rs:325
13152024-11-14T00:18:13.590ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a file = illumos-utils/src/zone.rs:363
13162024-11-14T00:18:13.596ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4 file = illumos-utils/src/zone.rs:363
13172024-11-14T00:18:13.603ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184 file = illumos-utils/src/zone.rs:363
13182024-11-14T00:18:13.610ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13 file = illumos-utils/src/zone.rs:363
13192024-11-14T00:18:13.615ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b file = illumos-utils/src/zone.rs:363
13202024-11-14T00:18:22.664ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40006
13212024-11-14T00:18:22.666ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1098 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40006 req_id = 7dbe0a79-4361-4a7d-b06c-3261fbe1ff6f response_code = 200 uri = /baseboard
13222024-11-14T00:18:22.992ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13232024-11-14T00:18:22.992ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
13242024-11-14T00:18:23.089ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13252024-11-14T00:18:23.100ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e85dd8a7-1d78-4ad6-b3eb-52a2b375b603'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13262024-11-14T00:18:23.100ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
13272024-11-14T00:18:23.103ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e6e03840-7feb-4068-8c49-369b714d0403/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5f314772-c044-4325-bd83-2bad974ed53f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13282024-11-14T00:18:23.103ZINFOSledAgent (ServiceManager): Booting oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
13292024-11-14T00:18:23.111ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cd288598-8732-4379-8880-15961c186724'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13302024-11-14T00:18:23.112ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b559beaa-6e7a-42a2-960f-2b76d3d77d35'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13312024-11-14T00:18:23.112ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322024-11-14T00:18:23.112ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='142cfc40-edd4-419b-bcb0-3e2c7c215218'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13332024-11-14T00:18:23.112ZINFOSledAgent (ServiceManager): Booting oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
13342024-11-14T00:18:23.122ZINFOSledAgent (ServiceManager): Booting oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
13352024-11-14T00:18:23.128ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
13362024-11-14T00:18:23.135ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
13372024-11-14T00:18:23.142ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
13382024-11-14T00:18:23.149ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_da3c518e-c769-471a-bde6-cca14456f7ec/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5cc77889-bb85-4966-947a-27a15e8a5388'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13392024-11-14T00:18:23.149ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
13402024-11-14T00:18:23.247ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d9026c6a-d422-44cb-bc5d-8d2f96235d23'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412024-11-14T00:18:23.255ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
13422024-11-14T00:18:23.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 58.071066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
13432024-11-14T00:18:23.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 51.268539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
13442024-11-14T00:18:23.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 26.521949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
13452024-11-14T00:18:23.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 42.504089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
13462024-11-14T00:18:23.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 65.242202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
13472024-11-14T00:18:23.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 62.743609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
13482024-11-14T00:18:23.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 36.864358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
13492024-11-14T00:18:23.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 95.801239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
13502024-11-14T00:18:23.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 72.887965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
13512024-11-14T00:18:23.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 93.033418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
13522024-11-14T00:18:23.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 48.314484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
13532024-11-14T00:18:23.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 95.393658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
13542024-11-14T00:18:23.488ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='ad042fde-503a-4314-8c8c-afa2f783d145'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552024-11-14T00:18:23.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 124.542154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
13562024-11-14T00:18:23.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 93.255431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
13572024-11-14T00:18:23.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 75.925407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
13582024-11-14T00:18:23.517ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
13592024-11-14T00:18:23.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 82.023503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
13602024-11-14T00:18:23.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 106.591599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
13612024-11-14T00:18:23.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 66.942431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
13622024-11-14T00:18:23.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 147.308543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
13632024-11-14T00:18:23.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 96.507105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
13642024-11-14T00:18:23.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 202.204859ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
13652024-11-14T00:18:23.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 249.715936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
13662024-11-14T00:18:23.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 266.372971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
13672024-11-14T00:18:23.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 279.666123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
13682024-11-14T00:18:23.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 168.968738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
13692024-11-14T00:18:23.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 99.268617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
13702024-11-14T00:18:23.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 132.69983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
13712024-11-14T00:18:23.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 133.347218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
13722024-11-14T00:18:23.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 146.64938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
13732024-11-14T00:18:23.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 440.975527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
13742024-11-14T00:18:23.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 249.572267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
13752024-11-14T00:18:23.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 28.024439ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
13762024-11-14T00:18:23.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 461.454996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
13772024-11-14T00:18:23.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 563.431489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
13782024-11-14T00:18:23.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 391.152324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
13792024-11-14T00:18:23.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 305.461404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
13802024-11-14T00:18:23.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 133.714745ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
13812024-11-14T00:18:23.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 445.735484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
13822024-11-14T00:18:23.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 266.352226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
13832024-11-14T00:18:23.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 290.874849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
13842024-11-14T00:18:23.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 460.987396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
13852024-11-14T00:18:23.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 230.329367ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
13862024-11-14T00:18:24.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 249.015344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
13872024-11-14T00:18:24.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 572.619791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
13882024-11-14T00:18:24.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 480.658214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
13892024-11-14T00:18:24.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 534.541659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
13902024-11-14T00:18:24.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 579.948466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
13912024-11-14T00:18:24.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 913.128707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
13922024-11-14T00:18:24.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 550.316551ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
13932024-11-14T00:18:24.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 1.014780153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
13942024-11-14T00:18:24.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 511.519851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
13952024-11-14T00:18:24.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 674.694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
13962024-11-14T00:18:24.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.117318395s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
13972024-11-14T00:18:24.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 729.140739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
13982024-11-14T00:18:24.585ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13992024-11-14T00:18:24.585ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14002024-11-14T00:18:24.603ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012024-11-14T00:18:24.603ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14022024-11-14T00:18:24.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 731.225713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
14032024-11-14T00:18:24.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 1.488100693s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
14042024-11-14T00:18:24.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 945.416741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
14052024-11-14T00:18:24.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 827.659376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
14062024-11-14T00:18:24.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 612.387101ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
14072024-11-14T00:18:24.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 673.962763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
14082024-11-14T00:18:24.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 48.217896ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14092024-11-14T00:18:24.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 45.158664ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14102024-11-14T00:18:24.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 131.11274ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14112024-11-14T00:18:24.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 138.279687ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14122024-11-14T00:18:25.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 542.72851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
14132024-11-14T00:18:25.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 293.278053ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14142024-11-14T00:18:25.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 118.881908ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14152024-11-14T00:18:25.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 834.803246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
14162024-11-14T00:18:25.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 960.489376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
14172024-11-14T00:18:25.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 261.981902ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14182024-11-14T00:18:25.294ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c601eb12-9b6f-42f4-9031-23b1449568c2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14192024-11-14T00:18:25.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 547.246008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
14202024-11-14T00:18:25.312ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
14212024-11-14T00:18:25.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 303.331832ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14222024-11-14T00:18:25.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 1.043734534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
14232024-11-14T00:18:25.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 735.582524ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
14242024-11-14T00:18:25.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 603.793151ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14252024-11-14T00:18:25.480ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 92.199477632s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
14262024-11-14T00:18:25.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 1.407916808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
14272024-11-14T00:18:25.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 776.864685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
14282024-11-14T00:18:25.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 28.173868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
14292024-11-14T00:18:25.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 136.392618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
14302024-11-14T00:18:25.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 1.35169476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
14312024-11-14T00:18:25.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.102406436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
14322024-11-14T00:18:25.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 454.756639ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14332024-11-14T00:18:25.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 1.209888247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
14342024-11-14T00:18:25.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 234.957203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
14352024-11-14T00:18:25.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 846.438068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
14362024-11-14T00:18:25.906ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14372024-11-14T00:18:25.911ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
14382024-11-14T00:18:25.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 505.139834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
14392024-11-14T00:18:25.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 519.457738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
14402024-11-14T00:18:26.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.419453705s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14412024-11-14T00:18:26.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 1.334951926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
14422024-11-14T00:18:26.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 865.010742ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14432024-11-14T00:18:26.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 51.328838ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
14442024-11-14T00:18:26.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 976.289856ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
14452024-11-14T00:18:26.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 86.584758ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
14462024-11-14T00:18:26.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.007084341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
14472024-11-14T00:18:26.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 1.070164439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
14482024-11-14T00:18:26.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.29316917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
14492024-11-14T00:18:26.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 1.178525311s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
14502024-11-14T00:18:27.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 296.113811ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
14512024-11-14T00:18:27.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 715.929565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
14522024-11-14T00:18:27.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 1.487306032s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14532024-11-14T00:18:27.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 784.070482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
14542024-11-14T00:18:27.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 852.155754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
14552024-11-14T00:18:27.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 578.095701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
14562024-11-14T00:18:27.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.352661818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
14572024-11-14T00:18:27.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 1.210607617s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
14582024-11-14T00:18:27.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 700.308155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
14592024-11-14T00:18:27.312ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5d197ef6-7d58-4152-8a63-88374989a904/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='adfb66b1-9646-46e2-8377-712c2f4b587e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14602024-11-14T00:18:27.312ZINFOSledAgent (ServiceManager): Booting oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
14612024-11-14T00:18:27.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 406.199798ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
14622024-11-14T00:18:27.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 1.422326133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
14632024-11-14T00:18:27.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 643.720287ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14642024-11-14T00:18:27.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 54.341906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
14652024-11-14T00:18:27.663ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14662024-11-14T00:18:27.663ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
14672024-11-14T00:18:27.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 87.260186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
14682024-11-14T00:18:27.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 1.138290405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
14692024-11-14T00:18:27.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 1.107893281s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
14702024-11-14T00:18:27.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 121.259264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
14712024-11-14T00:18:27.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 843.270907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
14722024-11-14T00:18:27.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.129923153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
14732024-11-14T00:18:27.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 637.183339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
14742024-11-14T00:18:27.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 983.712525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
14752024-11-14T00:18:27.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 239.473249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
14762024-11-14T00:18:27.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 65.259757ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
14772024-11-14T00:18:27.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 646.231586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
14782024-11-14T00:18:28.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 1.014168264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
14792024-11-14T00:18:28.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 97.62725ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
14802024-11-14T00:18:28.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 251.748953ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
14812024-11-14T00:18:28.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 792.854446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
14822024-11-14T00:18:28.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.006776863s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
14832024-11-14T00:18:28.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 615.321731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
14842024-11-14T00:18:28.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.187629602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
14852024-11-14T00:18:28.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 1.382847992s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
14862024-11-14T00:18:28.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 303.835174ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
14872024-11-14T00:18:28.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 878.071708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
14882024-11-14T00:18:28.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 934.821379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
14892024-11-14T00:18:28.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 817.117184ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
14902024-11-14T00:18:28.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 1.048052558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
14912024-11-14T00:18:28.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 504.512847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
14922024-11-14T00:18:28.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 623.219942ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
14932024-11-14T00:18:28.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 1.455726242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
14942024-11-14T00:18:28.845ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14952024-11-14T00:18:28.846ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
14962024-11-14T00:18:28.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 1.469732797s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
14972024-11-14T00:18:28.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 1.003245326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
14982024-11-14T00:18:28.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 583.848909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
14992024-11-14T00:18:28.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 1.375296163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
15002024-11-14T00:18:28.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 600.559049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
15012024-11-14T00:18:29.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.348202413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
15022024-11-14T00:18:29.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 557.861635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
15032024-11-14T00:18:29.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 1.04867021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
15042024-11-14T00:18:29.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 593.934025ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
15052024-11-14T00:18:29.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 58.233546ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15062024-11-14T00:18:29.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 90.339759ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15072024-11-14T00:18:29.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 1.022402779s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
15082024-11-14T00:18:29.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 288.848421ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15092024-11-14T00:18:29.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.138901613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
15102024-11-14T00:18:29.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 1.065812385s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
15112024-11-14T00:18:29.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.112902185s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
15122024-11-14T00:18:29.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 1.228055361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
15132024-11-14T00:18:29.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 538.634062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
15142024-11-14T00:18:29.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 1.099119848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
15152024-11-14T00:18:29.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 1.053916799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
15162024-11-14T00:18:29.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 585.149807ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15172024-11-14T00:18:29.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 527.0315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
15182024-11-14T00:18:29.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 969.946171ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
15192024-11-14T00:18:29.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.421668852s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
15202024-11-14T00:18:29.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 924.436796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
15212024-11-14T00:18:30.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 1.11451705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
15222024-11-14T00:18:30.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 1.211436952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
15232024-11-14T00:18:30.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 561.454635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
15242024-11-14T00:18:30.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 592.010293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
15252024-11-14T00:18:30.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 917.331172ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15262024-11-14T00:18:30.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 680.540371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
15272024-11-14T00:18:30.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 937.352081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
15282024-11-14T00:18:30.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 1.165675703s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
15292024-11-14T00:18:30.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 1.271573466s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
15302024-11-14T00:18:30.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 910.450376ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
15312024-11-14T00:18:30.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.084678516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
15322024-11-14T00:18:30.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.086250364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
15332024-11-14T00:18:30.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 1.498943614s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
15342024-11-14T00:18:30.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 775.496557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
15352024-11-14T00:18:30.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 999.036239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
15362024-11-14T00:18:30.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 1.227573593s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
15372024-11-14T00:18:30.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 643.072504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
15382024-11-14T00:18:30.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 1.221367928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
15392024-11-14T00:18:30.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 574.094827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
15402024-11-14T00:18:31.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 1.044534551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
15412024-11-14T00:18:31.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 1.105968011s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
15422024-11-14T00:18:31.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.10180545s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
15432024-11-14T00:18:31.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 532.647785ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15442024-11-14T00:18:31.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.188996084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
15452024-11-14T00:18:31.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 910.454393ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
15462024-11-14T00:18:31.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 514.199508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
15472024-11-14T00:18:31.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 1.247247732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
15482024-11-14T00:18:31.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 605.227622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
15492024-11-14T00:18:31.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 1.385266338s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
15502024-11-14T00:18:31.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 1.452755884s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
15512024-11-14T00:18:31.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.258297235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
15522024-11-14T00:18:31.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 898.395407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
15532024-11-14T00:18:31.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 821.5368ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
15542024-11-14T00:18:31.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 1.2226527s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
15552024-11-14T00:18:31.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 1.096747649s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15562024-11-14T00:18:32.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 669.725074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
15572024-11-14T00:18:32.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 865.108576ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
15582024-11-14T00:18:32.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 773.28891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
15592024-11-14T00:18:32.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 777.209468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
15602024-11-14T00:18:32.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 738.50401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
15612024-11-14T00:18:32.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 1.304074426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
15622024-11-14T00:18:32.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 1.002246603s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
15632024-11-14T00:18:32.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 677.479746ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
15642024-11-14T00:18:32.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 1.404995579s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
15652024-11-14T00:18:32.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.007713444s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
15662024-11-14T00:18:32.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 1.237453109s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
15672024-11-14T00:18:32.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.157292984s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
15682024-11-14T00:18:32.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 991.104781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
15692024-11-14T00:18:32.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 750.832648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
15702024-11-14T00:18:32.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 844.934077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
15712024-11-14T00:18:32.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 691.722853ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
15722024-11-14T00:18:32.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 534.951057ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15732024-11-14T00:18:32.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 1.248008452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
15742024-11-14T00:18:32.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 913.191631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
15752024-11-14T00:18:33.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 538.095281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
15762024-11-14T00:18:33.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 1.487034898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
15772024-11-14T00:18:33.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 1.265290387s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
15782024-11-14T00:18:33.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.46337646s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
15792024-11-14T00:18:33.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 1.371603164s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
15802024-11-14T00:18:33.270ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15812024-11-14T00:18:33.270ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
15822024-11-14T00:18:33.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 1.269962572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
15832024-11-14T00:18:33.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 58.901059ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
15842024-11-14T00:18:33.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 716.719431ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
15852024-11-14T00:18:33.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 963.004846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
15862024-11-14T00:18:33.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.354648161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
15872024-11-14T00:18:33.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 66.525441ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
15882024-11-14T00:18:33.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.080118547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
15892024-11-14T00:18:33.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 653.659052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
15902024-11-14T00:18:33.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 183.994284ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
15912024-11-14T00:18:33.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 1.025624944s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
15922024-11-14T00:18:33.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 758.401415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
15932024-11-14T00:18:33.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 1.274996467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
15942024-11-14T00:18:33.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 1.22948722s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
15952024-11-14T00:18:33.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 520.155231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
15962024-11-14T00:18:33.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 530.594904ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
15972024-11-14T00:18:33.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 1.348922807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
15982024-11-14T00:18:33.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 249.572035ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
15992024-11-14T00:18:34.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 979.573082ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
16002024-11-14T00:18:34.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 1.198281942s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
16012024-11-14T00:18:34.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 1.16159465s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
16022024-11-14T00:18:34.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 1.15474093s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
16032024-11-14T00:18:34.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 619.642267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
16042024-11-14T00:18:34.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 1.251987166s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
16052024-11-14T00:18:34.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 892.313218ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
16062024-11-14T00:18:34.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 1.070248781s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
16072024-11-14T00:18:34.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 1.031320817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
16082024-11-14T00:18:34.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 895.34737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
16092024-11-14T00:18:34.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.159943838s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
16102024-11-14T00:18:34.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.203040122s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
16112024-11-14T00:18:34.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 1.018844363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
16122024-11-14T00:18:34.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 630.388903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
16132024-11-14T00:18:34.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 533.567561ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
16142024-11-14T00:18:34.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 974.275418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
16152024-11-14T00:18:34.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 1.035633819s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
16162024-11-14T00:18:35.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 981.735149ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
16172024-11-14T00:18:35.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 903.988685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
16182024-11-14T00:18:35.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 1.177579826s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
16192024-11-14T00:18:35.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 1.097966121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
16202024-11-14T00:18:35.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 697.797624ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
16212024-11-14T00:18:35.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.108258329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
16222024-11-14T00:18:35.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 634.377446ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
16232024-11-14T00:18:35.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 1.329430429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
16242024-11-14T00:18:35.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 642.169185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
16252024-11-14T00:18:35.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 1.132910316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
16262024-11-14T00:18:35.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 1.172066496s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
16272024-11-14T00:18:35.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d") failed: Property not found. retry in 1.019090815s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
16282024-11-14T00:18:35.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 676.880292ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
16292024-11-14T00:18:35.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 1.275649492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
16302024-11-14T00:18:35.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 995.436925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
16312024-11-14T00:18:35.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.340044238s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
16322024-11-14T00:18:35.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.343925895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
16332024-11-14T00:18:35.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.09192794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
16342024-11-14T00:18:36.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 990.783234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
16352024-11-14T00:18:36.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 1.031537069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
16362024-11-14T00:18:36.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 694.508421ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
16372024-11-14T00:18:36.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 525.591862ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
16382024-11-14T00:18:36.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 764.52643ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
16392024-11-14T00:18:36.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 1.225509584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
16402024-11-14T00:18:36.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 707.958848ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
16412024-11-14T00:18:36.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 564.403444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
16422024-11-14T00:18:36.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 531.582423ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
16432024-11-14T00:18:36.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.263072982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
16442024-11-14T00:18:36.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 824.75808ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
16452024-11-14T00:18:37.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.192037466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
16462024-11-14T00:18:37.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 990.067974ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
16472024-11-14T00:18:37.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.351528783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
16482024-11-14T00:18:37.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 1.481609462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
16492024-11-14T00:18:37.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 872.328171ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
16502024-11-14T00:18:37.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.438093403s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
16512024-11-14T00:18:37.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 1.401551838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
16522024-11-14T00:18:37.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 618.583291ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
16532024-11-14T00:18:37.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 559.155813ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
16542024-11-14T00:18:37.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 810.341699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
16552024-11-14T00:18:37.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 1.121557313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
16562024-11-14T00:18:37.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 977.751438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
16572024-11-14T00:18:37.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 1.278299761s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
16582024-11-14T00:18:37.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 951.87427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
16592024-11-14T00:18:37.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 665.073225ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
16602024-11-14T00:18:37.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 1.401299562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
16612024-11-14T00:18:37.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 1.01230083s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
16622024-11-14T00:18:37.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4") failed: Property not found. retry in 1.048980676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
16632024-11-14T00:18:37.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 848.207973ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
16642024-11-14T00:18:37.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 557.411581ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
16652024-11-14T00:18:38.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 892.416704ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
16662024-11-14T00:18:38.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 1.140262909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
16672024-11-14T00:18:38.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 1.316825255s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
16682024-11-14T00:18:38.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 1.022010928s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
16692024-11-14T00:18:38.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 683.666157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
16702024-11-14T00:18:38.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 712.575338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
16712024-11-14T00:18:38.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.313349417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
16722024-11-14T00:18:38.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 1.483830735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
16732024-11-14T00:18:38.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 1.186293956s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
16742024-11-14T00:18:38.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 1.24187467s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
16752024-11-14T00:18:38.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 826.227426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
16762024-11-14T00:18:38.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 598.07316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
16772024-11-14T00:18:38.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 864.20205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
16782024-11-14T00:18:38.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.07046177s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
16792024-11-14T00:18:38.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 652.642283ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
16802024-11-14T00:18:38.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 836.960899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
16812024-11-14T00:18:38.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 1.36048329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
16822024-11-14T00:18:38.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 1.076564955s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
16832024-11-14T00:18:38.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 632.941016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
16842024-11-14T00:18:39.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0") failed: Property not found. retry in 1.146070342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
16852024-11-14T00:18:39.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 516.373726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
16862024-11-14T00:18:39.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 628.974913ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
16872024-11-14T00:18:39.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e") failed: Property not found. retry in 1.357538269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
16882024-11-14T00:18:39.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 1.024215812s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
16892024-11-14T00:18:39.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3") failed: Property not found. retry in 1.277583877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
16902024-11-14T00:18:39.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184") failed: Property not found. retry in 1.457282459s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
16912024-11-14T00:18:39.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 703.184672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
16922024-11-14T00:18:39.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 769.688053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
16932024-11-14T00:18:39.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f") failed: Property not found. retry in 893.114279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
16942024-11-14T00:18:39.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145") failed: Property not found. retry in 624.394341ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
16952024-11-14T00:18:39.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b") failed: Property not found. retry in 760.119246ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
16962024-11-14T00:18:39.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e") failed: Property not found. retry in 1.41300822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
16972024-11-14T00:18:39.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2") failed: Property not found. retry in 935.765259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
16982024-11-14T00:18:39.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 619.661836ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
16992024-11-14T00:18:39.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4") failed: Property not found. retry in 1.236271943s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
17002024-11-14T00:18:39.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a") failed: Property not found. retry in 1.399018743s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
17012024-11-14T00:18:40.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 1.127777849s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
17022024-11-14T00:18:40.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb") failed: Property not found. retry in 1.146477874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
17032024-11-14T00:18:40.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c") failed: Property not found. retry in 1.288622708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
17042024-11-14T00:18:40.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157") failed: Property not found. retry in 1.177721794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
17052024-11-14T00:18:40.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a") failed: Property not found. retry in 1.160048973s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
17062024-11-14T00:18:40.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13") failed: Property not found. retry in 1.158978618s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
17072024-11-14T00:18:41.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 607.673988ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
17082024-11-14T00:18:41.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 1.347226482s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
17092024-11-14T00:18:43.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 1.327899626s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
17102024-11-14T00:18:44.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 1.048901136s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
17112024-11-14T00:18:45.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 720.284506ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
17122024-11-14T00:18:46.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93") failed: Property not found. retry in 1.201910426s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
17132024-11-14T00:18:46.614ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/nexus.rs:527 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
17142024-11-14T00:18:46.615ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
17152024-11-14T00:18:47.214ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/nexus.rs:527 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
17162024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_ff5ba4ab-19ec-4089-86e3-65a9903e98eb
17172024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_1cc5aabb-5fa0-4a35-8abc-1a785efd506e
17182024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_df51b222-8234-4074-91c0-cdaaebfaa9a4
17192024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_11aeeaea-9ff6-414f-9c46-5ea13e8786b3
17202024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b2a35788-883a-4af6-8781-03b47e51c157
17212024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_6880e62c-aa82-46ed-8fbf-fcd0d42c3184
17222024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_b501ed1c-871c-451e-b97c-1d88e152ca13
17232024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_ebb4e1fe-7acf-4a7f-becc-0cc3dd02839c
17242024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_d06da591-b39e-4924-be5a-46bd48b9952b
17252024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_f6ae4a1b-61c3-453e-a52a-0df59bfd354a
17262024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_91fec770-b0c9-4024-b18f-060e66c7615e
17272024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_df1760d7-ef0e-4186-8196-958d7090b69a
17282024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_3e82f96f-8255-41a3-bd38-1deecfd537a0
17292024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_8d6a1d55-57dc-42aa-8004-81f26f56cbb2
17302024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_cc78a4b6-11d6-4f1c-8800-1a7f6b00f09d
17312024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_211f63fe-3256-4889-92da-e44182f6d93f
17322024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_d671b8e1-b507-4777-9196-b14d5f25fd93
17332024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_800ba40d-d75b-43c3-938f-70c63a5ef6b4
17342024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_ad042fde-503a-4314-8c8c-afa2f783d145
17352024-11-14T00:18:47.500ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17362024-11-14T00:18:47.510ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17372024-11-14T00:18:47.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37051301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42432 req_id = 8be75914-fa63-40db-95d0-e174b776e0a0 response_code = 204 uri = /omicron-zones
17382024-11-14T00:18:47.522ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1446
17392024-11-14T00:18:47.522ZINFOSledAgent (RSS): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17402024-11-14T00:18:47.522ZINFOSledAgent (RSS): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17412024-11-14T00:18:47.524ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
17422024-11-14T00:18:47.526ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:799
17432024-11-14T00:18:47.569ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1011
17442024-11-14T00:18:47.572ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17452024-11-14T00:18:47.618ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
17462024-11-14T00:18:47.672ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17472024-11-14T00:18:47.735ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17482024-11-14T00:18:47.862ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17492024-11-14T00:18:47.971ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17502024-11-14T00:18:48.122ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17512024-11-14T00:18:48.409ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17522024-11-14T00:18:48.621ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
17532024-11-14T00:18:48.782ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17542024-11-14T00:18:49.184ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17552024-11-14T00:18:49.210ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/nexus.rs:527 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
17562024-11-14T00:18:49.597ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17572024-11-14T00:18:49.624ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e211d163-be78-4663-b73f-baf5e9462a10) file = sled-agent/src/probe_manager.rs:231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
17582024-11-14T00:18:50.023ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17592024-11-14T00:18:50.751ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17602024-11-14T00:18:51.520ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/fcfbb675-622a-4d07-9c7d-02f1c7317864/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17612024-11-14T00:18:52.722ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59809
17622024-11-14T00:18:52.724ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59809 req_id = a00bbeff-8373-4db9-aed1-4ea49cf71afa response_code = 200 uri = /baseboard
17632024-11-14T00:18:52.985ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7e16200f-ee33-4c15-b022-85bfee601c12", "content-length": "173", "date": "Thu, 14 Nov 2024 00:18:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fcfbb675-622a-4d07-9c7d-02f1c7317864\"", request_id: "7e16200f-ee33-4c15-b022-85bfee601c12" } file = sled-agent/src/rack_setup/service.rs:1073
17642024-11-14T00:18:53.468ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
17652024-11-14T00:18:53.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35067
17662024-11-14T00:18:53.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17672024-11-14T00:18:53.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17682024-11-14T00:18:53.613ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
17692024-11-14T00:18:53.613ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
17702024-11-14T00:18:53.628ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17712024-11-14T00:18:53.628ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3
17722024-11-14T00:18:53.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36601
17732024-11-14T00:18:53.644ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17742024-11-14T00:18:53.644ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17752024-11-14T00:18:53.645ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
17762024-11-14T00:18:53.649ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
17772024-11-14T00:18:53.659ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17782024-11-14T00:18:53.659ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5d197ef6-7d58-4152-8a63-88374989a904
17792024-11-14T00:18:53.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43216
17802024-11-14T00:18:53.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43216 req_id = 1e4357aa-15b8-4919-9c9d-c7164d9de42a response_code = 200 uri = /vpc-routes
17812024-11-14T00:18:53.675ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17822024-11-14T00:18:53.675ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3
17832024-11-14T00:18:53.705ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
17842024-11-14T00:18:53.705ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17852024-11-14T00:18:53.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43216 req_id = 1d00ec8f-60b7-49fd-831a-2236dd6313dd response_code = 204 uri = /eip-gateways
17862024-11-14T00:18:53.705ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5d197ef6-7d58-4152-8a63-88374989a904
17872024-11-14T00:18:53.722ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17882024-11-14T00:18:53.722ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272
17892024-11-14T00:18:53.740ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17902024-11-14T00:18:53.740ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272
17912024-11-14T00:18:53.758ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17922024-11-14T00:18:53.758ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a
17932024-11-14T00:18:53.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56883
17942024-11-14T00:18:53.771ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17952024-11-14T00:18:53.771ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17962024-11-14T00:18:53.771ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
17972024-11-14T00:18:53.779ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
17982024-11-14T00:18:53.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53141
17992024-11-14T00:18:53.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38596
18002024-11-14T00:18:53.784ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18012024-11-14T00:18:53.784ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a
18022024-11-14T00:18:53.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5027 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38596 req_id = c187221f-a492-4cb5-98f4-6419bc901099 response_code = 200 uri = /v2p
18032024-11-14T00:18:53.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9831 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53141 req_id = 664c11db-d1cb-4000-bd17-ed939f4c8957 response_code = 200 uri = /v2p
18042024-11-14T00:18:53.800ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18052024-11-14T00:18:53.800ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da3c518e-c769-471a-bde6-cca14456f7ec
18062024-11-14T00:18:53.814ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18072024-11-14T00:18:53.814ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3
18082024-11-14T00:18:53.830ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18092024-11-14T00:18:53.830ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da3c518e-c769-471a-bde6-cca14456f7ec
18102024-11-14T00:18:53.855ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18112024-11-14T00:18:53.855ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5d197ef6-7d58-4152-8a63-88374989a904
18122024-11-14T00:18:53.869ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18132024-11-14T00:18:53.869ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12
18142024-11-14T00:18:53.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39581
18152024-11-14T00:18:53.887ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18162024-11-14T00:18:53.887ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12
18172024-11-14T00:18:53.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39581 req_id = a4ab46d7-d4ef-4ac2-b92b-894be626285f response_code = 200 uri = /v2p
18182024-11-14T00:18:53.902ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18192024-11-14T00:18:53.902ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e6e03840-7feb-4068-8c49-369b714d0403
18202024-11-14T00:18:53.918ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18212024-11-14T00:18:53.918ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272
18222024-11-14T00:18:53.933ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18232024-11-14T00:18:53.937ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e6e03840-7feb-4068-8c49-369b714d0403
18242024-11-14T00:18:53.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6854 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43216 req_id = 07497acf-90eb-4eaa-8e1a-710f1f1356ad response_code = 204 uri = /vpc-routes
18252024-11-14T00:18:53.953ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18262024-11-14T00:18:53.953ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b
18272024-11-14T00:18:53.965ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18282024-11-14T00:18:53.965ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a
18292024-11-14T00:18:53.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18302024-11-14T00:18:53.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b
18312024-11-14T00:18:53.995ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18322024-11-14T00:18:53.995ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003
18332024-11-14T00:18:54.013ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18342024-11-14T00:18:54.013ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003
18352024-11-14T00:18:54.026ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18362024-11-14T00:18:54.026ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da3c518e-c769-471a-bde6-cca14456f7ec
18372024-11-14T00:18:54.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 417960 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35067 req_id = 1a57c81f-d0c8-47ce-8fcc-e372207712c3 response_code = 200 uri = /inventory
18382024-11-14T00:18:54.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 408216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36601 req_id = 6bfb641f-0bf0-458f-88f8-c3beba987414 response_code = 200 uri = /inventory
18392024-11-14T00:18:54.049ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18402024-11-14T00:18:54.049ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12
18412024-11-14T00:18:54.072ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18422024-11-14T00:18:54.072ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e6e03840-7feb-4068-8c49-369b714d0403
18432024-11-14T00:18:54.093ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18442024-11-14T00:18:54.093ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b
18452024-11-14T00:18:54.113ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18462024-11-14T00:18:54.113ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003
18472024-11-14T00:18:54.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 358753 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56883 req_id = c5d10701-b5c1-4edd-acc4-2545190ec3ec response_code = 200 uri = /inventory
18482024-11-14T00:18:55.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56360
18492024-11-14T00:18:55.362ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18502024-11-14T00:18:55.362ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18512024-11-14T00:18:55.362ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
18522024-11-14T00:18:55.362ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
18532024-11-14T00:18:55.373ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18542024-11-14T00:18:55.373ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3
18552024-11-14T00:18:55.397ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18562024-11-14T00:18:55.397ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5d197ef6-7d58-4152-8a63-88374989a904
18572024-11-14T00:18:55.419ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18582024-11-14T00:18:55.419ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272
18592024-11-14T00:18:55.442ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18602024-11-14T00:18:55.442ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a
18612024-11-14T00:18:55.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35029
18622024-11-14T00:18:55.460ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18632024-11-14T00:18:55.460ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18642024-11-14T00:18:55.461ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18652024-11-14T00:18:55.461ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18662024-11-14T00:18:55.461ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18672024-11-14T00:18:55.461ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18682024-11-14T00:18:55.461ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18692024-11-14T00:18:55.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 978 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35029 req_id = 351bd916-0225-409f-856e-926d094890dc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18702024-11-14T00:18:55.462ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18712024-11-14T00:18:55.462ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da3c518e-c769-471a-bde6-cca14456f7ec
18722024-11-14T00:18:55.465ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1083
18732024-11-14T00:18:55.484ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18742024-11-14T00:18:55.484ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12
18752024-11-14T00:18:55.507ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18762024-11-14T00:18:55.507ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e6e03840-7feb-4068-8c49-369b714d0403
18772024-11-14T00:18:55.527ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18782024-11-14T00:18:55.527ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b
18792024-11-14T00:18:55.547ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18802024-11-14T00:18:55.547ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003
18812024-11-14T00:18:55.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198023 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56360 req_id = e9afa345-314f-4277-b04e-7fa190164303 response_code = 200 uri = /inventory
18822024-11-14T00:18:55.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59737
18832024-11-14T00:18:55.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18842024-11-14T00:18:55.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18852024-11-14T00:18:55.711ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
18862024-11-14T00:18:55.711ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
18872024-11-14T00:18:55.723ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18882024-11-14T00:18:55.723ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3
18892024-11-14T00:18:55.748ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18902024-11-14T00:18:55.748ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5d197ef6-7d58-4152-8a63-88374989a904
18912024-11-14T00:18:55.775ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18922024-11-14T00:18:55.775ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272
18932024-11-14T00:18:55.799ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18942024-11-14T00:18:55.799ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a
18952024-11-14T00:18:55.828ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18962024-11-14T00:18:55.828ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da3c518e-c769-471a-bde6-cca14456f7ec
18972024-11-14T00:18:55.849ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18982024-11-14T00:18:55.849ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12
18992024-11-14T00:18:55.869ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19002024-11-14T00:18:55.870ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e6e03840-7feb-4068-8c49-369b714d0403
19012024-11-14T00:18:55.889ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19022024-11-14T00:18:55.889ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b
19032024-11-14T00:18:55.909ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19042024-11-14T00:18:55.909ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003
19052024-11-14T00:18:55.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59737 req_id = 5e54e358-8875-471a-bd3f-a4ad03741f0d response_code = 200 uri = /inventory
19062024-11-14T00:18:55.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41407
19072024-11-14T00:18:55.941ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19082024-11-14T00:18:55.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19092024-11-14T00:18:55.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19102024-11-14T00:18:55.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19112024-11-14T00:18:55.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19122024-11-14T00:18:55.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19132024-11-14T00:18:55.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19142024-11-14T00:18:55.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41407 req_id = 1cb0bf5c-458a-4603-966a-d2621ca984dc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19152024-11-14T00:18:56.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57004
19162024-11-14T00:18:56.148ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19172024-11-14T00:18:56.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19182024-11-14T00:18:56.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19192024-11-14T00:18:56.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19202024-11-14T00:18:56.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19212024-11-14T00:18:56.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19222024-11-14T00:18:56.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19232024-11-14T00:18:56.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57004 req_id = 1906478e-c97e-4998-9e8a-3f47b58ead1e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19242024-11-14T00:18:56.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39230
19252024-11-14T00:18:56.935ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19262024-11-14T00:18:56.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19272024-11-14T00:18:56.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19282024-11-14T00:18:56.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19292024-11-14T00:18:56.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19302024-11-14T00:18:56.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19312024-11-14T00:18:56.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19322024-11-14T00:18:56.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39230 req_id = a138ee8a-2a44-4d43-a2e6-c3e73d190408 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19332024-11-14T00:19:04.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54348
19342024-11-14T00:19:04.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54348 req_id = c2356b0e-7aee-4d28-99c4-654599ab3a7a response_code = 200 uri = /vpc-routes
19352024-11-14T00:19:04.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
19362024-11-14T00:19:04.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54348 req_id = 3da662c9-2008-450b-8e51-5ea3e77979ff response_code = 204 uri = /eip-gateways
19372024-11-14T00:19:04.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54348 req_id = 00c8ea20-e5be-4e91-ac6a-6cf33ac9c906 response_code = 204 uri = /vpc-routes
19382024-11-14T00:19:22.760ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36144
19392024-11-14T00:19:22.760ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36144 req_id = 0dc1201a-8f7f-4a7b-b40c-7442de8af79f response_code = 200 uri = /baseboard
19402024-11-14T00:19:23.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63294
19412024-11-14T00:19:23.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63294 req_id = 3aa7ad5e-f172-4b59-80d3-accb2265d728 response_code = 200 uri = /vpc-routes
19422024-11-14T00:19:23.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35550
19432024-11-14T00:19:23.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35550 req_id = 3cd54a8a-5036-4192-b6d8-49e50aeb689e response_code = 200 uri = /vpc-routes
19442024-11-14T00:19:23.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37196
19452024-11-14T00:19:23.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37196 req_id = 2c8ccebf-b012-47b8-82be-0c5c5b64113e response_code = 200 uri = /v2p
19462024-11-14T00:19:23.554ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
19472024-11-14T00:19:23.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63294 req_id = c204e74c-0278-4a31-9476-3349cc43e9cf response_code = 204 uri = /eip-gateways
19482024-11-14T00:19:23.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56615
19492024-11-14T00:19:23.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56615 req_id = b9066d43-4411-4b34-9755-209b34c9847c response_code = 200 uri = /vpc-routes
19502024-11-14T00:19:23.586ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
19512024-11-14T00:19:23.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35550 req_id = d87aaeeb-32ec-46aa-a520-e53ae76f0adf response_code = 204 uri = /eip-gateways
19522024-11-14T00:19:23.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35550 req_id = ba4c4b39-75f3-481a-990c-9d96cfa5e7e8 response_code = 204 uri = /vpc-routes
19532024-11-14T00:19:23.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35198
19542024-11-14T00:19:23.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35198 req_id = 1d5de55f-8ec1-48c5-a36e-49dfe7a77866 response_code = 200 uri = /v2p
19552024-11-14T00:19:23.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63294 req_id = 8a244ed3-340e-4f1b-833c-9da7b113df04 response_code = 204 uri = /vpc-routes
19562024-11-14T00:19:23.617ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
19572024-11-14T00:19:23.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56615 req_id = 97fde898-435c-430c-9d4d-ae42749601a9 response_code = 204 uri = /eip-gateways
19582024-11-14T00:19:23.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41017
19592024-11-14T00:19:23.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41017 req_id = a9fe17d7-ef8c-4e41-98fe-94ff41b815bd response_code = 200 uri = /v2p
19602024-11-14T00:19:23.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56615 req_id = 8db72e9e-9fd7-4409-b45c-9b9371ce3c1d response_code = 204 uri = /vpc-routes
19612024-11-14T00:19:23.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34513
19622024-11-14T00:19:23.688ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19632024-11-14T00:19:23.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19642024-11-14T00:19:23.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137533 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34513 req_id = b91a3e79-1492-4b13-a005-ea93a108d6e0 response_code = 204 uri = /switch-ports
19652024-11-14T00:19:23.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42672
19662024-11-14T00:19:23.825ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19672024-11-14T00:19:23.864ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19682024-11-14T00:19:23.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92187 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42672 req_id = defb83ca-3a89-417b-a408-4ffde45c5670 response_code = 204 uri = /switch-ports
19692024-11-14T00:19:23.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47342
19702024-11-14T00:19:23.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19712024-11-14T00:19:23.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34513 req_id = dc875667-45fc-4945-873d-7210be5c0862 response_code = 200 uri = /network-bootstore-config
19722024-11-14T00:19:23.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4472 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42672 req_id = dacecc7e-aab4-4f65-90c7-f1e0b3b0f0d2 response_code = 200 uri = /network-bootstore-config
19732024-11-14T00:19:23.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19742024-11-14T00:19:23.979ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19752024-11-14T00:19:23.979ZINFOSledAgent (bootstore): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19762024-11-14T00:19:23.980ZINFOSledAgent (bootstore): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19772024-11-14T00:19:23.981ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19782024-11-14T00:19:23.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3776 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34513 req_id = 71520b38-43df-47d6-b867-8598f735abe6 response_code = 204 uri = /network-bootstore-config
19792024-11-14T00:19:23.982ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19802024-11-14T00:19:23.982ZINFOSledAgent (bootstore): Writing ledger to /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19812024-11-14T00:19:23.982ZINFOSledAgent (bootstore): Writing ledger to /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19822024-11-14T00:19:23.982ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19832024-11-14T00:19:23.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 437 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42672 req_id = 17894baf-ba37-45c2-8d01-4a2614b7a4c7 response_code = 204 uri = /network-bootstore-config
19842024-11-14T00:19:24.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88105 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47342 req_id = f82a6168-e1d0-42e5-b4c5-73ab858a660c response_code = 204 uri = /switch-ports
19852024-11-14T00:19:24.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47342 req_id = 3fdfee6b-12a1-48b5-bc46-483b0fab0c40 response_code = 200 uri = /network-bootstore-config
19862024-11-14T00:19:45.420ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19872024-11-14T00:19:52.793ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58987
19882024-11-14T00:19:52.793ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58987 req_id = 250f1b6b-b24e-49af-896c-e82779054e6e response_code = 200 uri = /baseboard
19892024-11-14T00:19:53.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56908
19902024-11-14T00:19:53.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56908 req_id = 9fb08e7c-e1b5-4dd5-af79-0a2703f56d2c response_code = 200 uri = /vpc-routes
19912024-11-14T00:19:53.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48361
19922024-11-14T00:19:53.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48361 req_id = e27cdb69-586e-4bb7-8669-18cbe5714917 response_code = 200 uri = /vpc-routes
19932024-11-14T00:19:53.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58447
19942024-11-14T00:19:53.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58447 req_id = 32b31614-4a96-4cb8-855a-9dc0fbafb7f2 response_code = 200 uri = /v2p
19952024-11-14T00:19:53.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
19962024-11-14T00:19:53.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56908 req_id = 638da130-a873-464c-9d5b-6b48228a116f response_code = 204 uri = /eip-gateways
19972024-11-14T00:19:53.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56908 req_id = 4a738c9f-fdd3-47f2-9abf-326d2e609f64 response_code = 204 uri = /vpc-routes
19982024-11-14T00:19:53.555ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
19992024-11-14T00:19:53.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48361 req_id = 5e68873b-682b-4e4e-b31f-a7b42eef1493 response_code = 204 uri = /eip-gateways
20002024-11-14T00:19:53.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48361 req_id = a2a59fa2-82a0-49d2-ade5-e68381be0bf0 response_code = 204 uri = /vpc-routes
20012024-11-14T00:19:53.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48332
20022024-11-14T00:19:53.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48332 req_id = 4859cdfa-ac62-4566-9da8-e5f87d41ee57 response_code = 200 uri = /vpc-routes
20032024-11-14T00:19:53.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46747
20042024-11-14T00:19:53.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46747 req_id = 129ca4c2-7a4c-479c-a2f3-0f951ec81e8f response_code = 200 uri = /v2p
20052024-11-14T00:19:53.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56586
20062024-11-14T00:19:53.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56586 req_id = 3c873c0b-f087-435b-8b06-d0277cd646d3 response_code = 200 uri = /v2p
20072024-11-14T00:19:53.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47408
20082024-11-14T00:19:53.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20092024-11-14T00:19:53.802ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20102024-11-14T00:19:53.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47408 req_id = 9b840632-1dbe-44c8-9750-695003977408 response_code = 204 uri = /switch-ports
20112024-11-14T00:19:53.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35074
20122024-11-14T00:19:53.863ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
20132024-11-14T00:19:53.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48332 req_id = 4e5d6c76-dc6e-48ee-8e73-46e80ae7b70e response_code = 204 uri = /eip-gateways
20142024-11-14T00:19:53.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47408 req_id = f49c22b9-6710-44d3-8c9d-9388350db603 response_code = 200 uri = /network-bootstore-config
20152024-11-14T00:19:53.864ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20162024-11-14T00:19:53.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36077
20172024-11-14T00:19:53.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48332 req_id = 8ea7bcc4-886b-4aed-9291-cfd86344d13a response_code = 204 uri = /vpc-routes
20182024-11-14T00:19:53.902ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20192024-11-14T00:19:53.956ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20202024-11-14T00:19:53.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92166 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35074 req_id = a93b1fa3-5a05-40b7-90ac-61f0c80df76e response_code = 204 uri = /switch-ports
20212024-11-14T00:19:53.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35074 req_id = d9571015-727f-42e9-a658-72a7f79025a5 response_code = 200 uri = /network-bootstore-config
20222024-11-14T00:19:53.991ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20232024-11-14T00:19:54.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36077 req_id = 12479e22-9457-4378-af94-e684224cc9fa response_code = 204 uri = /switch-ports
20242024-11-14T00:19:54.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3772 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36077 req_id = 2adc8a7a-1ef6-4500-876d-758bb998f261 response_code = 200 uri = /network-bootstore-config
20252024-11-14T00:20:06.122ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:54990 remote_addr = [fd00:1122:3344:101::d]:57798 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
20262024-11-14T00:20:06.146ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 23650 local_addr = [fd00:1122:3344:101::1]:54990 method = GET remote_addr = [fd00:1122:3344:101::d]:57798 req_id = 9fe349b5-eefd-4747-9a10-5b2c3d94da2c response_code = 200 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 uri = /e211d163-be78-4663-b73f-baf5e9462a10
20272024-11-14T00:20:22.830ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43852
20282024-11-14T00:20:22.830ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43852 req_id = 3c999211-2703-4811-8a4b-31f8d3102861 response_code = 200 uri = /baseboard
20292024-11-14T00:20:23.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53005
20302024-11-14T00:20:23.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53005 req_id = 0e7e6734-3dcf-45a5-b6bd-93696fc80b2d response_code = 200 uri = /vpc-routes
20312024-11-14T00:20:23.439ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
20322024-11-14T00:20:23.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53005 req_id = 8b4397d9-20b2-42f5-ad51-89d731fefbba response_code = 204 uri = /eip-gateways
20332024-11-14T00:20:23.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53005 req_id = a836f88c-0590-479e-a893-92d63c5d999f response_code = 204 uri = /vpc-routes
20342024-11-14T00:20:23.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38416
20352024-11-14T00:20:23.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38416 req_id = 869fc7d9-b392-45a3-9b9c-ea208b1d63d5 response_code = 200 uri = /vpc-routes
20362024-11-14T00:20:23.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40127
20372024-11-14T00:20:23.474ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20382024-11-14T00:20:23.515ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20392024-11-14T00:20:23.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103864 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40127 req_id = a6a43b65-08cc-427f-aee8-03e4e7a6e7e9 response_code = 204 uri = /switch-ports
20402024-11-14T00:20:23.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59982
20412024-11-14T00:20:23.578ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
20422024-11-14T00:20:23.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38416 req_id = 216c7321-1b1b-4bba-a4fb-0ec72b704853 response_code = 204 uri = /eip-gateways
20432024-11-14T00:20:23.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33287
20442024-11-14T00:20:23.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49119
20452024-11-14T00:20:23.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57070
20462024-11-14T00:20:23.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40127 req_id = 47c176a6-7438-4e85-abcf-dbb2617e1595 response_code = 200 uri = /network-bootstore-config
20472024-11-14T00:20:23.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57070 req_id = 831ee00f-17bf-4dc6-b41d-9a65649b0c72 response_code = 200 uri = /vpc-routes
20482024-11-14T00:20:23.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49119 req_id = 6d51a38f-dc46-485a-917c-165c039b2ce3 response_code = 200 uri = /v2p
20492024-11-14T00:20:23.581ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20502024-11-14T00:20:23.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8549 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59982 req_id = 26021999-0b53-4b28-beb2-b03dcd2b57a8 response_code = 200 uri = /v2p
20512024-11-14T00:20:23.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38416 req_id = f002baef-c839-4497-9ea1-3a0c2b4f1816 response_code = 204 uri = /vpc-routes
20522024-11-14T00:20:23.623ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20532024-11-14T00:20:23.627ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
20542024-11-14T00:20:23.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 421 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57070 req_id = cc87726c-ad00-4bc6-98ae-553a5a4953f0 response_code = 204 uri = /eip-gateways
20552024-11-14T00:20:23.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57070 req_id = 5bf15957-6c2e-423b-9f3f-fec9f7dc7725 response_code = 204 uri = /vpc-routes
20562024-11-14T00:20:23.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108540 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33287 req_id = af4dcbc6-9e76-439d-bf93-df1f22532be7 response_code = 204 uri = /switch-ports
20572024-11-14T00:20:23.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33287 req_id = 7e2d02e6-d25b-41ad-ab55-5bd1760ab3dc response_code = 200 uri = /network-bootstore-config
20582024-11-14T00:20:23.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48216
20592024-11-14T00:20:23.696ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20602024-11-14T00:20:23.730ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20612024-11-14T00:20:23.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91940 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48216 req_id = a9d12a5a-e192-49a5-894f-b115939eb130 response_code = 204 uri = /switch-ports
20622024-11-14T00:20:23.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48216 req_id = a94aff6e-f909-4c74-bdbb-1742eb24303a response_code = 200 uri = /network-bootstore-config
20632024-11-14T00:20:23.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43941
20642024-11-14T00:20:23.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43941 req_id = 3f4f8620-95d2-4aae-8de8-e7da36f05454 response_code = 200 uri = /v2p
20652024-11-14T00:20:52.864ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56630
20662024-11-14T00:20:52.865ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56630 req_id = 1f6186be-cbd6-4981-ad5d-35ffd9ffbece response_code = 200 uri = /baseboard
20672024-11-14T00:20:53.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34745
20682024-11-14T00:20:53.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34745 req_id = d6024c7a-dbbe-4d5d-bfb1-538c2166f748 response_code = 200 uri = /vpc-routes
20692024-11-14T00:20:53.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60992
20702024-11-14T00:20:53.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60992 req_id = c2871d6c-ecf0-4be2-b28d-8e71e1660cdb response_code = 200 uri = /vpc-routes
20712024-11-14T00:20:53.578ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
20722024-11-14T00:20:53.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60992 req_id = 3d2cdc8e-1e1e-4a48-aebe-a53dae7b8d72 response_code = 204 uri = /eip-gateways
20732024-11-14T00:20:53.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60992 req_id = 30685508-441e-422b-82bf-af46915f1ce0 response_code = 204 uri = /vpc-routes
20742024-11-14T00:20:53.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58330
20752024-11-14T00:20:53.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58330 req_id = 201e46a3-a9c2-475e-8fa1-d8eedc74cf8c response_code = 200 uri = /v2p
20762024-11-14T00:20:53.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63759
20772024-11-14T00:20:53.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63759 req_id = b976177e-8a1d-4c20-9940-89ad1af04bd3 response_code = 200 uri = /v2p
20782024-11-14T00:20:53.653ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
20792024-11-14T00:20:53.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34745 req_id = 6ea8250a-e006-4600-9355-ef2edbc499a9 response_code = 204 uri = /eip-gateways
20802024-11-14T00:20:53.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57685
20812024-11-14T00:20:53.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20822024-11-14T00:20:53.694ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20832024-11-14T00:20:53.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97973 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57685 req_id = 4906be33-0dce-443a-bfac-d9e2be4227f3 response_code = 204 uri = /switch-ports
20842024-11-14T00:20:53.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43986
20852024-11-14T00:20:53.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56953
20862024-11-14T00:20:53.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43986 req_id = ac4c5235-b8dc-474a-8fd0-4ce83262a152 response_code = 200 uri = /vpc-routes
20872024-11-14T00:20:53.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57685 req_id = b04c02fb-470b-47e3-b545-eb309bb97dfa response_code = 200 uri = /network-bootstore-config
20882024-11-14T00:20:53.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 476 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34745 req_id = aa9e5fe7-3837-47a6-a3d4-5fb723df2f74 response_code = 204 uri = /vpc-routes
20892024-11-14T00:20:53.752ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20902024-11-14T00:20:53.793ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20912024-11-14T00:20:53.797ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
20922024-11-14T00:20:53.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43986 req_id = bee94ee2-0dc8-4de8-9fa8-1c934e7a6abe response_code = 204 uri = /eip-gateways
20932024-11-14T00:20:53.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50604
20942024-11-14T00:20:53.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50604 req_id = 70a38521-7316-43bc-83f7-d80d3f16253c response_code = 200 uri = /v2p
20952024-11-14T00:20:53.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 455 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43986 req_id = 670e959b-3f32-47cf-a63f-3b1d6232bc27 response_code = 204 uri = /vpc-routes
20962024-11-14T00:20:53.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58547
20972024-11-14T00:20:53.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96080 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56953 req_id = c4d71f7f-556a-4401-835f-891984645bde response_code = 204 uri = /switch-ports
20982024-11-14T00:20:53.848ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20992024-11-14T00:20:53.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 689 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56953 req_id = bf94a33d-bd68-4505-884e-471330ae0f73 response_code = 200 uri = /network-bootstore-config
21002024-11-14T00:20:53.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21012024-11-14T00:20:53.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93172 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58547 req_id = ac142d2b-c2c6-47c3-8a39-495d6db00a0e response_code = 204 uri = /switch-ports
21022024-11-14T00:20:53.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58547 req_id = cea931ca-8a5f-42c1-b7c5-fabe2e5cf17c response_code = 200 uri = /network-bootstore-config
21032024-11-14T00:21:22.900ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44310
21042024-11-14T00:21:22.900ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44310 req_id = 8f20e71c-8738-4ff9-ad67-f0e605a9b2ae response_code = 200 uri = /baseboard
21052024-11-14T00:21:23.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57875
21062024-11-14T00:21:23.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57875 req_id = ec9ce992-0e73-4783-aaf4-4714ddd942fd response_code = 200 uri = /vpc-routes
21072024-11-14T00:21:23.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55758
21082024-11-14T00:21:23.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55758 req_id = 5a64814f-2730-429a-a46e-0999fa09729b response_code = 200 uri = /vpc-routes
21092024-11-14T00:21:23.443ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
21102024-11-14T00:21:23.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57875 req_id = 1b4117f0-3129-4852-962c-1961bb8e3d1f response_code = 204 uri = /eip-gateways
21112024-11-14T00:21:23.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57875 req_id = 7ecaf725-4842-4847-a8b9-3d451bea14a6 response_code = 204 uri = /vpc-routes
21122024-11-14T00:21:23.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51698
21132024-11-14T00:21:23.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51698 req_id = b6533778-7f9b-4ec0-9615-56998dbeca4d response_code = 200 uri = /v2p
21142024-11-14T00:21:23.500ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
21152024-11-14T00:21:23.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55758 req_id = 9609203b-398d-49fa-9d1f-b69581f01d62 response_code = 204 uri = /eip-gateways
21162024-11-14T00:21:23.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37400
21172024-11-14T00:21:23.505ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21182024-11-14T00:21:23.545ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21192024-11-14T00:21:23.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37400 req_id = 8cad6df0-259d-4233-bf98-73e1cd0d5bd3 response_code = 204 uri = /switch-ports
21202024-11-14T00:21:23.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60963
21212024-11-14T00:21:23.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48135
21222024-11-14T00:21:23.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 480 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55758 req_id = d039ad7f-1c54-4d0f-9507-efbe7e12ec7b response_code = 204 uri = /vpc-routes
21232024-11-14T00:21:23.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37400 req_id = b91effaa-cbd2-4bee-bcfb-fe39ca5325af response_code = 200 uri = /network-bootstore-config
21242024-11-14T00:21:23.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60963 req_id = 636f7197-b5c2-4946-b2c3-abf64c5aab25 response_code = 200 uri = /v2p
21252024-11-14T00:21:23.603ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21262024-11-14T00:21:23.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21272024-11-14T00:21:23.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64167
21282024-11-14T00:21:23.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64167 req_id = 2e089798-b525-4bb5-9e31-bf84e17a30bd response_code = 200 uri = /vpc-routes
21292024-11-14T00:21:23.676ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
21302024-11-14T00:21:23.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64167 req_id = 7d6c35a5-1f52-49c1-9047-47951cd5c9e0 response_code = 204 uri = /eip-gateways
21312024-11-14T00:21:23.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 436 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64167 req_id = bf7b1074-fb8c-4c39-bad4-b3f9e1908dbd response_code = 204 uri = /vpc-routes
21322024-11-14T00:21:23.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48135 req_id = 27b8ece3-ec0c-421a-8b94-c2442771a515 response_code = 204 uri = /switch-ports
21332024-11-14T00:21:23.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48135 req_id = e5ecfbd7-7b35-4e11-bb36-196ac5f533cd response_code = 200 uri = /network-bootstore-config
21342024-11-14T00:21:23.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37533
21352024-11-14T00:21:23.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21362024-11-14T00:21:23.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21372024-11-14T00:21:23.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37533 req_id = 097bd910-86cd-4ec3-abc0-59df437612c4 response_code = 204 uri = /switch-ports
21382024-11-14T00:21:23.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33021
21392024-11-14T00:21:23.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37533 req_id = 67173a6a-3be8-4116-9646-2009736a6e33 response_code = 200 uri = /network-bootstore-config
21402024-11-14T00:21:23.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33021 req_id = 3f854ded-e934-47ed-b5ac-8524dd032d3d response_code = 200 uri = /v2p
21412024-11-14T00:21:52.934ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56957
21422024-11-14T00:21:52.934ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56957 req_id = e7ed2b88-687a-4031-a03b-c6a6ba4eee6b response_code = 200 uri = /baseboard
21432024-11-14T00:21:53.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44466
21442024-11-14T00:21:53.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44466 req_id = 3eec6022-9b94-4b48-9634-9025b3964db6 response_code = 200 uri = /vpc-routes
21452024-11-14T00:21:53.452ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
21462024-11-14T00:21:53.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44466 req_id = 4d2cb97c-66b0-4cca-92c5-391f8867a801 response_code = 204 uri = /eip-gateways
21472024-11-14T00:21:53.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44466 req_id = 0de81bc1-e194-4c12-990d-e468384caaba response_code = 204 uri = /vpc-routes
21482024-11-14T00:21:53.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54502
21492024-11-14T00:21:53.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54502 req_id = 477d1aea-3f12-46bf-9b7e-756cae8148ca response_code = 200 uri = /vpc-routes
21502024-11-14T00:21:53.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53134
21512024-11-14T00:21:53.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53134 req_id = f3f354d1-6f5a-4cc7-ab9c-6d1be82ccea1 response_code = 200 uri = /v2p
21522024-11-14T00:21:53.634ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
21532024-11-14T00:21:53.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54502 req_id = fbf7060f-d568-42f4-a094-26f3a8469a80 response_code = 204 uri = /eip-gateways
21542024-11-14T00:21:53.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54502 req_id = 92a16d5e-0b56-4518-a8e9-f74ca7dcd123 response_code = 204 uri = /vpc-routes
21552024-11-14T00:21:53.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43321
21562024-11-14T00:21:53.703ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21572024-11-14T00:21:53.745ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21582024-11-14T00:21:53.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102080 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43321 req_id = 1e92c546-b05f-4a66-8747-4dcde4c00c8a response_code = 204 uri = /switch-ports
21592024-11-14T00:21:53.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34507
21602024-11-14T00:21:53.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50190
21612024-11-14T00:21:53.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50190 req_id = b92d4801-fa76-4b28-bc3a-eedb4665ca25 response_code = 200 uri = /v2p
21622024-11-14T00:21:53.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34507 req_id = 72db6069-d9e7-4077-9ca8-c0a08e4f530d response_code = 200 uri = /vpc-routes
21632024-11-14T00:21:53.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43321 req_id = 0d2eb7a6-8290-4338-965a-feb5db4b7f11 response_code = 200 uri = /network-bootstore-config
21642024-11-14T00:21:53.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58748
21652024-11-14T00:21:53.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21662024-11-14T00:21:53.847ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21672024-11-14T00:21:53.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58748 req_id = 826001dc-fea7-42cd-968a-504f7b8664d4 response_code = 204 uri = /switch-ports
21682024-11-14T00:21:53.900ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
21692024-11-14T00:21:53.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34507 req_id = 714d9517-7363-4537-8a99-3b9ec57c1a6c response_code = 204 uri = /eip-gateways
21702024-11-14T00:21:53.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63488
21712024-11-14T00:21:53.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58748 req_id = d8860722-f872-4834-9088-f0f156c19541 response_code = 200 uri = /network-bootstore-config
21722024-11-14T00:21:53.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63488 req_id = c9ad0f2e-30a8-4d1e-9520-4a4584ae14b0 response_code = 200 uri = /v2p
21732024-11-14T00:21:53.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34507 req_id = 4fb79f55-4560-4c45-8c80-601509ed0be4 response_code = 204 uri = /vpc-routes
21742024-11-14T00:21:53.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47611
21752024-11-14T00:21:53.914ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21762024-11-14T00:21:53.949ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21772024-11-14T00:21:54.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92020 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47611 req_id = ae9619e6-b13f-4c79-a1f7-85115995e5b3 response_code = 204 uri = /switch-ports
21782024-11-14T00:21:54.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47611 req_id = 77548a91-a1b2-41a8-984f-3ba357202dc0 response_code = 200 uri = /network-bootstore-config
21792024-11-14T00:22:22.973ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57746
21802024-11-14T00:22:22.973ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57746 req_id = 3b6f0672-3c6a-48af-9976-cadcf78287ab response_code = 200 uri = /baseboard
21812024-11-14T00:22:23.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44675
21822024-11-14T00:22:23.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44675 req_id = 9424f1a5-8a49-4fc7-977b-b604c6950314 response_code = 200 uri = /vpc-routes
21832024-11-14T00:22:23.358ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
21842024-11-14T00:22:23.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44675 req_id = 12567859-332e-423d-a9a8-2a811ab1f6bd response_code = 204 uri = /eip-gateways
21852024-11-14T00:22:23.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34114
21862024-11-14T00:22:23.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34114 req_id = c4630934-d96e-4268-ae86-52c7db65d8ec response_code = 200 uri = /vpc-routes
21872024-11-14T00:22:23.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44675 req_id = 61ce1dbb-b762-4346-95fa-b0f76aa3e1fd response_code = 204 uri = /vpc-routes
21882024-11-14T00:22:23.374ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
21892024-11-14T00:22:23.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34114 req_id = 1b82e4d2-60ea-4dd3-89c2-9bdde24b2bc9 response_code = 204 uri = /eip-gateways
21902024-11-14T00:22:23.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34114 req_id = 21d71946-c293-4300-8544-78ebb0e83210 response_code = 204 uri = /vpc-routes
21912024-11-14T00:22:23.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49217
21922024-11-14T00:22:23.433ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21932024-11-14T00:22:23.484ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21942024-11-14T00:22:23.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49217 req_id = 57ef93b3-f46e-4d1c-8244-3593c8119e2b response_code = 204 uri = /switch-ports
21952024-11-14T00:22:23.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33577
21962024-11-14T00:22:23.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39321
21972024-11-14T00:22:23.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59224
21982024-11-14T00:22:23.551ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21992024-11-14T00:22:23.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33577 req_id = 81d39818-abba-4bb1-9ecb-5dce76f7e7a0 response_code = 200 uri = /v2p
22002024-11-14T00:22:23.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3906 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39321 req_id = 909a3f48-f1ef-42f6-b0a1-e14562815f5b response_code = 200 uri = /v2p
22012024-11-14T00:22:23.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4035 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49217 req_id = 3b059663-6a1e-4ee7-93bd-ddaa31183ea0 response_code = 200 uri = /network-bootstore-config
22022024-11-14T00:22:23.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50725
22032024-11-14T00:22:23.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50725 req_id = c9bb1169-afdf-483d-94d9-53c7d5f81047 response_code = 200 uri = /vpc-routes
22042024-11-14T00:22:23.587ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22052024-11-14T00:22:23.624ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
22062024-11-14T00:22:23.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50725 req_id = 431d38b2-9981-450c-9de0-dee6f8bccd96 response_code = 204 uri = /eip-gateways
22072024-11-14T00:22:23.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50725 req_id = 8bfb6b82-8c7e-42d5-b1a8-0f6de19a70f4 response_code = 204 uri = /vpc-routes
22082024-11-14T00:22:23.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59224 req_id = 94b5d386-de41-4c77-84c5-31839b9b6462 response_code = 204 uri = /switch-ports
22092024-11-14T00:22:23.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59224 req_id = 60046435-471f-45f2-9126-69a3ed76b175 response_code = 200 uri = /network-bootstore-config
22102024-11-14T00:22:23.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40988
22112024-11-14T00:22:23.662ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22122024-11-14T00:22:23.701ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22132024-11-14T00:22:23.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99454 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40988 req_id = be7f2e79-c520-4dab-ab12-f034e2077c37 response_code = 204 uri = /switch-ports
22142024-11-14T00:22:23.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44865
22152024-11-14T00:22:23.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40988 req_id = 51e61805-0eb4-4632-a349-2fab1c7723c6 response_code = 200 uri = /network-bootstore-config
22162024-11-14T00:22:23.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44865 req_id = 6b9f21fd-a4c5-4e6a-8bd6-8df95c34aac7 response_code = 200 uri = /v2p
22172024-11-14T00:22:53.007ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40633
22182024-11-14T00:22:53.007ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40633 req_id = 7b461397-1fda-4145-879b-36d4654b052b response_code = 200 uri = /baseboard
22192024-11-14T00:22:53.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54420
22202024-11-14T00:22:53.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54420 req_id = 8336bba2-dfc6-46cc-bfca-a5ac75bc7fc9 response_code = 200 uri = /vpc-routes
22212024-11-14T00:22:53.444ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
22222024-11-14T00:22:53.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54420 req_id = 4accf290-6977-4829-a1bd-7b71c4f2f155 response_code = 204 uri = /eip-gateways
22232024-11-14T00:22:53.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54420 req_id = 323807c1-96f3-420d-aafe-e955abb63c99 response_code = 204 uri = /vpc-routes
22242024-11-14T00:22:53.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44048
22252024-11-14T00:22:53.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44048 req_id = b095da8e-afcf-478a-99ea-741a64a2fd3e response_code = 200 uri = /v2p
22262024-11-14T00:22:53.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55843
22272024-11-14T00:22:53.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55843 req_id = 963c49e7-4f1e-45dd-ae7e-5cb81e6ed271 response_code = 200 uri = /vpc-routes
22282024-11-14T00:22:53.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50363
22292024-11-14T00:22:53.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50363 req_id = 8ed3630a-91b6-4799-a60a-a2a30ca3c876 response_code = 200 uri = /v2p
22302024-11-14T00:22:53.668ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
22312024-11-14T00:22:53.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55843 req_id = 668337be-2089-4e4c-8cf1-a94fbe702611 response_code = 204 uri = /eip-gateways
22322024-11-14T00:22:53.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55843 req_id = cf450a86-a35f-483e-8741-075534f6c20f response_code = 204 uri = /vpc-routes
22332024-11-14T00:22:53.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62376
22342024-11-14T00:22:53.716ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22352024-11-14T00:22:53.755ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22362024-11-14T00:22:53.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99576 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62376 req_id = 23cefcd8-6f34-4863-9c6a-17eeb87644c9 response_code = 204 uri = /switch-ports
22372024-11-14T00:22:53.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38061
22382024-11-14T00:22:53.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38061 req_id = 47f61468-9a37-4dba-a63a-c7f6afb67fd4 response_code = 200 uri = /vpc-routes
22392024-11-14T00:22:53.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62376 req_id = 9671e058-9684-42d0-8181-143f932ec680 response_code = 200 uri = /network-bootstore-config
22402024-11-14T00:22:53.863ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
22412024-11-14T00:22:53.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38061 req_id = dbe26d88-5440-4082-a0d4-99de57241b3f response_code = 204 uri = /eip-gateways
22422024-11-14T00:22:53.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38061 req_id = 2186a357-891d-4d9e-b667-edd292e5210e response_code = 204 uri = /vpc-routes
22432024-11-14T00:22:53.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41809
22442024-11-14T00:22:53.875ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22452024-11-14T00:22:53.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22462024-11-14T00:22:53.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93390 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41809 req_id = b397ac7f-2445-4d0f-bf18-b7ab2c0956c0 response_code = 204 uri = /switch-ports
22472024-11-14T00:22:53.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42543
22482024-11-14T00:22:53.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47746
22492024-11-14T00:22:53.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42543 req_id = 36525897-dc6c-446e-b885-0d9a14982e1d response_code = 200 uri = /v2p
22502024-11-14T00:22:53.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41809 req_id = 4942bac7-5b61-458c-acba-747b00e3e133 response_code = 200 uri = /network-bootstore-config
22512024-11-14T00:22:53.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22522024-11-14T00:22:54.006ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22532024-11-14T00:22:54.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96065 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47746 req_id = 74ba3b59-de08-4393-9ca8-0ae431e4bfb9 response_code = 204 uri = /switch-ports
22542024-11-14T00:22:54.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47746 req_id = 0dc59214-b504-4b20-b77a-f8d252bcb8b5 response_code = 200 uri = /network-bootstore-config
22552024-11-14T00:23:23.044ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37071
22562024-11-14T00:23:23.045ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37071 req_id = d5537847-9fb8-4da8-9cdb-59afb9f14bbc response_code = 200 uri = /baseboard
22572024-11-14T00:23:23.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34786
22582024-11-14T00:23:23.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34786 req_id = ef931e93-ebbf-4a7f-848d-7712e4190708 response_code = 200 uri = /vpc-routes
22592024-11-14T00:23:23.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52913
22602024-11-14T00:23:23.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52913 req_id = bd314bee-2637-4741-9f51-73fd4cd84e5c response_code = 200 uri = /vpc-routes
22612024-11-14T00:23:23.407ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
22622024-11-14T00:23:23.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34786 req_id = bfa166ea-47fc-4a16-8c71-624f1b3eccd8 response_code = 204 uri = /eip-gateways
22632024-11-14T00:23:23.421ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
22642024-11-14T00:23:23.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52913 req_id = a9f27109-ed8b-42da-bbef-5659721dd4b3 response_code = 204 uri = /eip-gateways
22652024-11-14T00:23:23.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37033
22662024-11-14T00:23:23.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37033 req_id = a5cc55fd-f922-4edb-93ff-629f84330422 response_code = 200 uri = /v2p
22672024-11-14T00:23:23.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34786 req_id = d53b2627-2723-460e-9404-e8ad53543f5d response_code = 204 uri = /vpc-routes
22682024-11-14T00:23:23.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52913 req_id = a1c5494d-e89a-43ee-9b37-34ec7747eb03 response_code = 204 uri = /vpc-routes
22692024-11-14T00:23:23.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49505
22702024-11-14T00:23:23.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49505 req_id = 131816c0-2005-4575-8ebd-5d6480950878 response_code = 200 uri = /v2p
22712024-11-14T00:23:23.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48215
22722024-11-14T00:23:23.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22732024-11-14T00:23:23.523ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22742024-11-14T00:23:23.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107713 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48215 req_id = e9ce642b-b7e8-4d1b-8286-9e5249c87eb0 response_code = 204 uri = /switch-ports
22752024-11-14T00:23:23.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46051
22762024-11-14T00:23:23.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22772024-11-14T00:23:23.625ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22782024-11-14T00:23:23.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96234 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46051 req_id = b559a5c2-54a0-4145-a741-457914026bae response_code = 204 uri = /switch-ports
22792024-11-14T00:23:23.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39552
22802024-11-14T00:23:23.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39552 req_id = bcc7abc9-1653-4b79-8007-684ab12a3f29 response_code = 200 uri = /vpc-routes
22812024-11-14T00:23:23.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48215 req_id = cd61b08b-9516-498c-a573-37f632ec0297 response_code = 200 uri = /network-bootstore-config
22822024-11-14T00:23:23.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46051 req_id = 93450832-8bb9-483b-b385-66893cf86a10 response_code = 200 uri = /network-bootstore-config
22832024-11-14T00:23:23.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57446
22842024-11-14T00:23:23.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57446 req_id = 0eaa1a5a-a3d9-4da6-a39d-6e37125025b9 response_code = 200 uri = /v2p
22852024-11-14T00:23:23.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45252
22862024-11-14T00:23:23.705ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22872024-11-14T00:23:23.743ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22882024-11-14T00:23:23.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45252 req_id = bea687fd-7bd3-4373-8999-e610a7aeaabe response_code = 204 uri = /switch-ports
22892024-11-14T00:23:23.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45252 req_id = a91e8d0d-c72a-472a-b998-47bef85244fa response_code = 200 uri = /network-bootstore-config
22902024-11-14T00:23:23.800ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
22912024-11-14T00:23:23.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39552 req_id = c83449fc-baba-4670-8a5f-191de5595c71 response_code = 204 uri = /eip-gateways
22922024-11-14T00:23:23.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39552 req_id = eec9eaa9-d14f-4c1c-a8c2-6de995bdae77 response_code = 204 uri = /vpc-routes
22932024-11-14T00:23:53.078ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55159
22942024-11-14T00:23:53.078ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55159 req_id = ece18d36-7e79-4348-be31-b7385e04cdbe response_code = 200 uri = /baseboard
22952024-11-14T00:23:53.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57176
22962024-11-14T00:23:53.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57176 req_id = adf9d9ee-6788-4d7e-b088-4b9b7c3f4551 response_code = 200 uri = /v2p
22972024-11-14T00:23:53.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36570
22982024-11-14T00:23:53.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36570 req_id = 0ed84fee-b9a4-4986-96b5-70588c2916da response_code = 200 uri = /vpc-routes
22992024-11-14T00:23:53.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54564
23002024-11-14T00:23:53.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54564 req_id = 42aaf40c-354a-4206-844d-fe859d800812 response_code = 200 uri = /v2p
23012024-11-14T00:23:53.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
23022024-11-14T00:23:53.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36570 req_id = 93294cca-7e57-41a4-b3c8-6a2cdcbe18a7 response_code = 204 uri = /eip-gateways
23032024-11-14T00:23:53.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36570 req_id = 7ecf91ad-3968-43ed-a14e-e52e26032792 response_code = 204 uri = /vpc-routes
23042024-11-14T00:23:53.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50987
23052024-11-14T00:23:53.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50987 req_id = 51d7a097-42a4-4b21-bb7f-4fb503754bed response_code = 200 uri = /vpc-routes
23062024-11-14T00:23:53.647ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
23072024-11-14T00:23:53.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50987 req_id = 96a70d90-3512-4c58-9282-71ee4f72ea39 response_code = 204 uri = /eip-gateways
23082024-11-14T00:23:53.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50987 req_id = 303fbc12-d59f-47b0-b110-ac90e17726fd response_code = 204 uri = /vpc-routes
23092024-11-14T00:23:53.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60819
23102024-11-14T00:23:53.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23112024-11-14T00:23:53.734ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23122024-11-14T00:23:53.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60819 req_id = 0cdf6282-b3ca-45f9-a9f3-d9557989b259 response_code = 204 uri = /switch-ports
23132024-11-14T00:23:53.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63061
23142024-11-14T00:23:53.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35333
23152024-11-14T00:23:53.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35333 req_id = 00bd3f3a-3891-4992-a7c8-45af1192b91b response_code = 200 uri = /vpc-routes
23162024-11-14T00:23:53.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23172024-11-14T00:23:53.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60819 req_id = c3554ae7-6e25-4616-b9ff-eb9332b3baf2 response_code = 200 uri = /network-bootstore-config
23182024-11-14T00:23:53.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62205
23192024-11-14T00:23:53.810ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23202024-11-14T00:23:53.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23212024-11-14T00:23:53.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23222024-11-14T00:23:53.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23232024-11-14T00:23:53.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23242024-11-14T00:23:53.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23252024-11-14T00:23:53.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23262024-11-14T00:23:53.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62205 req_id = bc9049d9-3a38-4974-9060-c5777fccea54 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23272024-11-14T00:23:53.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59394
23282024-11-14T00:23:53.841ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23292024-11-14T00:23:53.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23302024-11-14T00:23:53.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23312024-11-14T00:23:53.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23322024-11-14T00:23:53.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23332024-11-14T00:23:53.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23342024-11-14T00:23:53.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23352024-11-14T00:23:53.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59394 req_id = eaf1301a-fbd8-4b4f-8c97-41b837074819 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23362024-11-14T00:23:53.846ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23372024-11-14T00:23:53.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
23382024-11-14T00:23:53.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35333 req_id = 3e5a3ef1-0f45-4c56-a2f2-35b63249ce7e response_code = 204 uri = /eip-gateways
23392024-11-14T00:23:53.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35333 req_id = 412f42c9-62b9-419a-82ec-1ae1623defb9 response_code = 204 uri = /vpc-routes
23402024-11-14T00:23:53.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60691
23412024-11-14T00:23:53.916ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23422024-11-14T00:23:53.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63061 req_id = f739f092-f96d-4b1f-8536-0ef39d81823c response_code = 204 uri = /switch-ports
23432024-11-14T00:23:53.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63061 req_id = 616c0abd-b34b-4319-be4e-4bd7fdd5e3a0 response_code = 200 uri = /network-bootstore-config
23442024-11-14T00:23:53.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46300
23452024-11-14T00:23:53.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46300 req_id = bd3ec008-fbec-446a-9557-b8b263ff14a3 response_code = 200 uri = /v2p
23462024-11-14T00:23:53.955ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23472024-11-14T00:23:54.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123039 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60691 req_id = 954f7afa-6b95-4fd6-8cee-f4c901cff733 response_code = 204 uri = /switch-ports
23482024-11-14T00:23:54.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60691 req_id = a6fe44aa-a654-429b-b4cb-dc43f52a6289 response_code = 200 uri = /network-bootstore-config
23492024-11-14T00:23:54.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50813
23502024-11-14T00:23:54.245ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23512024-11-14T00:23:54.245ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23522024-11-14T00:23:54.245ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23532024-11-14T00:23:54.245ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23542024-11-14T00:23:54.245ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23552024-11-14T00:23:54.245ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23562024-11-14T00:23:54.245ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23572024-11-14T00:23:54.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50813 req_id = 44439667-7ffd-4f29-84b1-bd77b5a8b37a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23582024-11-14T00:24:23.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60898
23592024-11-14T00:24:23.111ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60898 req_id = 6d2a59f3-dddb-40df-b772-d4ef7326780d response_code = 200 uri = /baseboard
23602024-11-14T00:24:23.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49030
23612024-11-14T00:24:23.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49030 req_id = 11b5fc15-9597-4ffb-942f-a77af39bb23a response_code = 200 uri = /vpc-routes
23622024-11-14T00:24:23.343ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
23632024-11-14T00:24:23.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49030 req_id = 2aa3cb03-b01b-469a-a8d7-296222590581 response_code = 204 uri = /eip-gateways
23642024-11-14T00:24:23.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40095
23652024-11-14T00:24:23.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40095 req_id = 68d8bcc5-6c6e-4d4c-bbc5-27431a1d934f response_code = 200 uri = /vpc-routes
23662024-11-14T00:24:23.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49030 req_id = c3ccf9c2-c73f-465b-be13-dad4dfb92d49 response_code = 204 uri = /vpc-routes
23672024-11-14T00:24:23.392ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
23682024-11-14T00:24:23.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40095 req_id = d687cc8a-6eb9-47d4-ab19-6de08771b649 response_code = 204 uri = /eip-gateways
23692024-11-14T00:24:23.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48809
23702024-11-14T00:24:23.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48809 req_id = 0900096e-0ac7-43dc-b663-5ef20b2a18aa response_code = 200 uri = /v2p
23712024-11-14T00:24:23.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40095 req_id = 1920d80a-b50e-42ec-a8fc-0597f048af20 response_code = 204 uri = /vpc-routes
23722024-11-14T00:24:23.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43866
23732024-11-14T00:24:23.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43866 req_id = b1e5806a-0c53-4aa6-8a50-0d7882db6110 response_code = 200 uri = /v2p
23742024-11-14T00:24:23.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37470
23752024-11-14T00:24:23.496ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23762024-11-14T00:24:23.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23772024-11-14T00:24:23.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37470 req_id = 07c7e6f4-c891-4c05-b52d-d5ff1aa6018a response_code = 204 uri = /switch-ports
23782024-11-14T00:24:23.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63884
23792024-11-14T00:24:23.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65042
23802024-11-14T00:24:23.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37470 req_id = 19b86820-d206-4db5-af94-b90026e3f679 response_code = 200 uri = /network-bootstore-config
23812024-11-14T00:24:23.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23822024-11-14T00:24:23.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65042 req_id = eeb305f5-45b1-41a4-a576-bf21ccb22225 response_code = 200 uri = /vpc-routes
23832024-11-14T00:24:23.638ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23842024-11-14T00:24:23.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
23852024-11-14T00:24:23.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65042 req_id = 6aff04aa-2aa3-4c5a-a31f-a86fbf1b2727 response_code = 204 uri = /eip-gateways
23862024-11-14T00:24:23.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86746 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63884 req_id = 923563e3-8a86-4ad4-a700-48f28439be67 response_code = 204 uri = /switch-ports
23872024-11-14T00:24:23.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63884 req_id = a6262f85-12ad-469f-94ec-d5baf7ba5b98 response_code = 200 uri = /network-bootstore-config
23882024-11-14T00:24:23.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62224
23892024-11-14T00:24:23.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62224 req_id = 003f17ba-a6b1-42cb-b30c-9763954cbbfd response_code = 200 uri = /v2p
23902024-11-14T00:24:23.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65042 req_id = da960d1e-57e2-4e0f-b98e-5cc7720c5b1c response_code = 204 uri = /vpc-routes
23912024-11-14T00:24:23.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38902
23922024-11-14T00:24:23.770ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23932024-11-14T00:24:23.804ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23942024-11-14T00:24:23.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38902 req_id = 98eb60df-097d-479f-89ca-d35206deb4e7 response_code = 204 uri = /switch-ports
23952024-11-14T00:24:23.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38902 req_id = de67b0cd-80a0-4524-b815-66af3ca13334 response_code = 200 uri = /network-bootstore-config
23962024-11-14T00:24:30.404ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23972024-11-14T00:24:30.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23982024-11-14T00:24:30.432ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1970, tv_nsec: 154902375 } time_to_next_cleanup = 599.99999804s
23992024-11-14T00:24:45.425ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24002024-11-14T00:24:53.145ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57501
24012024-11-14T00:24:53.146ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57501 req_id = 15db1241-a0a0-4fbf-b390-599667732300 response_code = 200 uri = /baseboard
24022024-11-14T00:24:53.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50961
24032024-11-14T00:24:53.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50961 req_id = e66c01c1-2abc-417c-8a08-b8300368e4c7 response_code = 200 uri = /vpc-routes
24042024-11-14T00:24:53.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56244
24052024-11-14T00:24:53.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56244 req_id = e30d6e5c-4621-4e8f-a6ac-74acf966f0a2 response_code = 200 uri = /vpc-routes
24062024-11-14T00:24:53.572ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
24072024-11-14T00:24:53.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50961 req_id = 6824a7d8-01f1-49ca-88a7-616fc7f21ed9 response_code = 204 uri = /eip-gateways
24082024-11-14T00:24:53.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50961 req_id = aea3df20-8ff9-41dd-88ff-ca9b1ac1bd69 response_code = 204 uri = /vpc-routes
24092024-11-14T00:24:53.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
24102024-11-14T00:24:53.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56244 req_id = 1db16b2f-27ab-44f9-bd34-44363569f4c2 response_code = 204 uri = /eip-gateways
24112024-11-14T00:24:53.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56244 req_id = ad33abda-9ed2-42be-917f-5c0bc384f639 response_code = 204 uri = /vpc-routes
24122024-11-14T00:24:53.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38627
24132024-11-14T00:24:53.733ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24142024-11-14T00:24:53.769ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24152024-11-14T00:24:53.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98882 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38627 req_id = 743bf0af-f167-4a04-b27f-b804da98f8e9 response_code = 204 uri = /switch-ports
24162024-11-14T00:24:53.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56704
24172024-11-14T00:24:53.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61197
24182024-11-14T00:24:53.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65473
24192024-11-14T00:24:53.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48186
24202024-11-14T00:24:53.832ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24212024-11-14T00:24:53.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56704 req_id = af737413-b715-44b4-9bd3-5122ca9d098b response_code = 200 uri = /v2p
24222024-11-14T00:24:53.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5382 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38627 req_id = 38ddfb5a-f26f-4e6e-9962-13b325a90ef5 response_code = 200 uri = /network-bootstore-config
24232024-11-14T00:24:53.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65473 req_id = ef2a599b-cbaa-44d2-b1a8-7e7856a292de response_code = 200 uri = /vpc-routes
24242024-11-14T00:24:53.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5536 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48186 req_id = 659ca472-2bbf-4d8d-9e3b-449945c4b0b3 response_code = 200 uri = /v2p
24252024-11-14T00:24:53.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
24262024-11-14T00:24:53.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65473 req_id = 052fe40a-1fcd-44b3-b5e5-b5a98f345b17 response_code = 204 uri = /eip-gateways
24272024-11-14T00:24:53.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24282024-11-14T00:24:53.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97519 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61197 req_id = f548efd2-299e-406f-abf9-9afd3d9d0a6d response_code = 204 uri = /switch-ports
24292024-11-14T00:24:53.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61197 req_id = 8b8a7d3a-638a-488c-b85b-2a6bba658eb3 response_code = 200 uri = /network-bootstore-config
24302024-11-14T00:24:53.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55896
24312024-11-14T00:24:53.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55896 req_id = a8bda562-c2dc-4330-b778-cf5f07b5e30d response_code = 200 uri = /v2p
24322024-11-14T00:24:53.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65473 req_id = 90673ea2-302b-44d2-a10b-c10bb54a4c4d response_code = 204 uri = /vpc-routes
24332024-11-14T00:24:54.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62525
24342024-11-14T00:24:54.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24352024-11-14T00:24:54.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24362024-11-14T00:24:54.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95072 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62525 req_id = cf5fc3d1-2eac-466e-b64d-de94c0c46020 response_code = 204 uri = /switch-ports
24372024-11-14T00:24:54.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62525 req_id = 0cd2f48d-bc5f-4150-9ea8-2aca73ef11a3 response_code = 200 uri = /network-bootstore-config
24382024-11-14T00:25:23.208ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41312
24392024-11-14T00:25:23.208ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41312 req_id = ffad8f4f-f68b-452b-8af0-b4584aedfd91 response_code = 200 uri = /baseboard
24402024-11-14T00:25:23.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42481
24412024-11-14T00:25:23.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42481 req_id = 88bb80d7-900c-47ab-a56c-03bd56d4e3c7 response_code = 200 uri = /vpc-routes
24422024-11-14T00:25:23.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52692
24432024-11-14T00:25:23.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52692 req_id = 04dfa8d5-2e45-4e3a-90a8-71ac5102ca4f response_code = 200 uri = /vpc-routes
24442024-11-14T00:25:23.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
24452024-11-14T00:25:23.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42481 req_id = 15b0904f-fba1-4b2c-b2a3-cb94ae7c1cf6 response_code = 204 uri = /eip-gateways
24462024-11-14T00:25:23.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42481 req_id = 947fda73-fe26-4961-92a5-28f133818a76 response_code = 204 uri = /vpc-routes
24472024-11-14T00:25:23.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56900
24482024-11-14T00:25:23.427ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24492024-11-14T00:25:23.477ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24502024-11-14T00:25:23.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56900 req_id = dbe3258a-bf1d-4ea3-855b-4ec927dab8f4 response_code = 204 uri = /switch-ports
24512024-11-14T00:25:23.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38592
24522024-11-14T00:25:23.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
24532024-11-14T00:25:23.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51544
24542024-11-14T00:25:23.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52692 req_id = 731deac8-fa5a-4ac3-a59e-49459c3457de response_code = 204 uri = /eip-gateways
24552024-11-14T00:25:23.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59490
24562024-11-14T00:25:23.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56900 req_id = a0568800-89e6-4e77-80b6-39d0292641fe response_code = 200 uri = /network-bootstore-config
24572024-11-14T00:25:23.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59490 req_id = e2821272-45d1-49e9-a0e2-04aa229a38e3 response_code = 200 uri = /v2p
24582024-11-14T00:25:23.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38592 req_id = 41f108eb-568d-4f91-8592-c2d38c98ed4e response_code = 200 uri = /v2p
24592024-11-14T00:25:23.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24602024-11-14T00:25:23.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52692 req_id = 1417be8b-ac7b-40b0-9c27-d06b29e82eb2 response_code = 204 uri = /vpc-routes
24612024-11-14T00:25:23.584ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24622024-11-14T00:25:23.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34014
24632024-11-14T00:25:23.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34014 req_id = 649ee768-9b82-41a2-8352-c067e9964e3c response_code = 200 uri = /v2p
24642024-11-14T00:25:23.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51544 req_id = 90511f40-cf44-4ab6-a890-311fe2b40c2c response_code = 204 uri = /switch-ports
24652024-11-14T00:25:23.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51544 req_id = 98829de3-e32c-49fd-83ad-4e2f56c201b1 response_code = 200 uri = /network-bootstore-config
24662024-11-14T00:25:23.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37227
24672024-11-14T00:25:23.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37227 req_id = d8c9d58a-194a-40d2-a4c6-ed1a1b337b59 response_code = 200 uri = /vpc-routes
24682024-11-14T00:25:23.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
24692024-11-14T00:25:23.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37227 req_id = 3c87aa64-f7ce-477e-8956-4fe2a1a20d32 response_code = 204 uri = /eip-gateways
24702024-11-14T00:25:23.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37227 req_id = 4e2faefc-a71d-4c2d-8f6e-0b478294c026 response_code = 204 uri = /vpc-routes
24712024-11-14T00:25:23.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56480
24722024-11-14T00:25:23.840ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24732024-11-14T00:25:23.880ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24742024-11-14T00:25:23.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56480 req_id = 0dc07539-38f1-46bb-8f38-18cdd6cc668c response_code = 204 uri = /switch-ports
24752024-11-14T00:25:23.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56480 req_id = b5abccfa-0d48-4384-b9b3-418dc6d83322 response_code = 200 uri = /network-bootstore-config
24762024-11-14T00:25:53.271ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43796
24772024-11-14T00:25:53.271ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43796 req_id = 3ecd95dc-4f14-4ec6-bb9f-57a402763626 response_code = 200 uri = /baseboard
24782024-11-14T00:25:53.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39629
24792024-11-14T00:25:53.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39629 req_id = b50703f3-730a-4f17-8289-778d033ab533 response_code = 200 uri = /v2p
24802024-11-14T00:25:53.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50791
24812024-11-14T00:25:53.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50791 req_id = d0c2fe67-e454-484d-8c32-a33dabec264b response_code = 200 uri = /vpc-routes
24822024-11-14T00:25:53.638ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
24832024-11-14T00:25:53.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50791 req_id = b74a604e-583b-4a3c-a6e1-f369053461b7 response_code = 204 uri = /eip-gateways
24842024-11-14T00:25:53.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50791 req_id = 867b4142-ae6e-4ff2-8f45-4cac0e582416 response_code = 204 uri = /vpc-routes
24852024-11-14T00:25:53.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42645
24862024-11-14T00:25:53.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42645 req_id = 2d8cb140-bf16-4ecb-a551-2fbc90fbfd72 response_code = 200 uri = /vpc-routes
24872024-11-14T00:25:53.733ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
24882024-11-14T00:25:53.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42645 req_id = d9552fcc-ab9d-4247-b5cf-dbd55e8f237e response_code = 204 uri = /eip-gateways
24892024-11-14T00:25:53.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42645 req_id = c3fe5965-42b9-49a9-a113-79df0daecbc6 response_code = 204 uri = /vpc-routes
24902024-11-14T00:25:53.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59281
24912024-11-14T00:25:53.742ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24922024-11-14T00:25:53.789ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24932024-11-14T00:25:53.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110648 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59281 req_id = 5c15ec03-99ec-48cc-9dae-d23ce6f92722 response_code = 204 uri = /switch-ports
24942024-11-14T00:25:53.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33013
24952024-11-14T00:25:53.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45622
24962024-11-14T00:25:53.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45622 req_id = a9b10818-4b2b-4e29-8966-9a182a3f0b12 response_code = 200 uri = /vpc-routes
24972024-11-14T00:25:53.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59281 req_id = 87e52d38-11cd-4745-a758-ff4b0991943c response_code = 200 uri = /network-bootstore-config
24982024-11-14T00:25:53.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33013 req_id = 5d686f53-c4f7-429b-8ae7-533d0341ad16 response_code = 200 uri = /v2p
24992024-11-14T00:25:53.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39046
25002024-11-14T00:25:53.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39046 req_id = d5b4c6a0-bb90-40c8-b554-5fb767d65294 response_code = 200 uri = /v2p
25012024-11-14T00:25:53.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42781
25022024-11-14T00:25:53.869ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25032024-11-14T00:25:53.907ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25042024-11-14T00:25:53.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42781 req_id = 02a57724-ff2c-4b29-9575-fcf50048f900 response_code = 204 uri = /switch-ports
25052024-11-14T00:25:53.964ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
25062024-11-14T00:25:53.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45622 req_id = b7e3322a-c9f0-49fd-bca0-9a01024d68c1 response_code = 204 uri = /eip-gateways
25072024-11-14T00:25:53.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33379
25082024-11-14T00:25:53.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25092024-11-14T00:25:53.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42781 req_id = ba90ccea-bf23-49a8-b94c-d84db49f431a response_code = 200 uri = /network-bootstore-config
25102024-11-14T00:25:53.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45622 req_id = e29ad3fb-ff54-4111-a493-9193702bf89e response_code = 204 uri = /vpc-routes
25112024-11-14T00:25:54.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25122024-11-14T00:25:54.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94824 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33379 req_id = 0b5baa68-cf98-4d24-82d1-7b7e2b71b501 response_code = 204 uri = /switch-ports
25132024-11-14T00:25:54.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33379 req_id = c83934a2-5ab2-4cfe-81ee-fc7ef158e0fa response_code = 200 uri = /network-bootstore-config
25142024-11-14T00:26:23.313ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61183
25152024-11-14T00:26:23.313ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61183 req_id = ddf66b25-5fb6-4f5d-a0ba-30a5ae48a475 response_code = 200 uri = /baseboard
25162024-11-14T00:26:23.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41084
25172024-11-14T00:26:23.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41084 req_id = 08111da7-7f26-41d0-9725-0463f24fd1d7 response_code = 200 uri = /vpc-routes
25182024-11-14T00:26:23.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49196
25192024-11-14T00:26:23.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49196 req_id = 58d04fb2-d3a4-4d59-a250-40fc1c8b2e92 response_code = 200 uri = /vpc-routes
25202024-11-14T00:26:23.407ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
25212024-11-14T00:26:23.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41084 req_id = 461ec814-92c7-439b-925a-2065df60dfc0 response_code = 204 uri = /eip-gateways
25222024-11-14T00:26:23.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35802
25232024-11-14T00:26:23.430ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25242024-11-14T00:26:23.484ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25252024-11-14T00:26:23.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126908 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35802 req_id = f1ac0f73-b999-4672-b10b-830ae6f8a252 response_code = 204 uri = /switch-ports
25262024-11-14T00:26:23.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38577
25272024-11-14T00:26:23.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51314
25282024-11-14T00:26:23.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45235
25292024-11-14T00:26:23.558ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
25302024-11-14T00:26:23.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49196 req_id = a235f3f9-02fc-4066-86e1-ba8ca8cbd6ef response_code = 204 uri = /eip-gateways
25312024-11-14T00:26:23.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35802 req_id = 16e3be5a-1e91-477f-b289-0e4d7b54aa22 response_code = 200 uri = /network-bootstore-config
25322024-11-14T00:26:23.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38577 req_id = 24cb51f4-e4ba-426b-8f34-1713c62ec319 response_code = 200 uri = /v2p
25332024-11-14T00:26:23.558ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25342024-11-14T00:26:23.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45235 req_id = fac8a974-756a-4b35-ab8f-25e3af0061e0 response_code = 200 uri = /v2p
25352024-11-14T00:26:23.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 504 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41084 req_id = 44a70c4b-46d2-48ff-9cee-37d4ab70239f response_code = 204 uri = /vpc-routes
25362024-11-14T00:26:23.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49196 req_id = d0bb9143-2c05-4271-922b-5471d6b09c2d response_code = 204 uri = /vpc-routes
25372024-11-14T00:26:23.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41901
25382024-11-14T00:26:23.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41901 req_id = d942373c-0269-4ab6-a72c-d40293e8284e response_code = 200 uri = /vpc-routes
25392024-11-14T00:26:23.597ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25402024-11-14T00:26:23.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
25412024-11-14T00:26:23.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41901 req_id = 43e4beff-37a9-4c4b-8a2e-f82423d3efea response_code = 204 uri = /eip-gateways
25422024-11-14T00:26:23.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41901 req_id = e8e6cd01-dcf2-480a-a546-8752c1ebe1c2 response_code = 204 uri = /vpc-routes
25432024-11-14T00:26:23.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54540
25442024-11-14T00:26:23.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54540 req_id = 8edb134d-7ff8-479f-86be-264cbcedef7d response_code = 200 uri = /v2p
25452024-11-14T00:26:23.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99950 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51314 req_id = 09f222b7-e4a1-4086-b216-c01857052c18 response_code = 204 uri = /switch-ports
25462024-11-14T00:26:23.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51314 req_id = fce3f124-944c-4a01-95bb-90b3dedb5e3d response_code = 200 uri = /network-bootstore-config
25472024-11-14T00:26:23.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41695
25482024-11-14T00:26:23.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25492024-11-14T00:26:23.733ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25502024-11-14T00:26:23.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92962 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41695 req_id = 9922bb20-608f-4e6e-8ffd-6653feabbc80 response_code = 204 uri = /switch-ports
25512024-11-14T00:26:23.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41695 req_id = da61382b-b532-4f0d-a9d8-f5d365dae102 response_code = 200 uri = /network-bootstore-config
25522024-11-14T00:26:53.366ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65045
25532024-11-14T00:26:53.367ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65045 req_id = 8fc6e58c-a190-41c6-a07a-f0836b184ffd response_code = 200 uri = /baseboard
25542024-11-14T00:26:53.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50492
25552024-11-14T00:26:53.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50492 req_id = 2130d683-feae-4591-9a8b-05961d068607 response_code = 200 uri = /vpc-routes
25562024-11-14T00:26:53.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43766
25572024-11-14T00:26:53.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43766 req_id = b44f5bff-b8e9-49c0-9a76-e8eb9cb1b5d5 response_code = 200 uri = /vpc-routes
25582024-11-14T00:26:53.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40925
25592024-11-14T00:26:53.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40925 req_id = d8985ba9-1d44-4728-b111-b7501c85ede9 response_code = 200 uri = /vpc-routes
25602024-11-14T00:26:53.692ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
25612024-11-14T00:26:53.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50492 req_id = a00fecb8-84e1-4476-9974-264aeafe9f78 response_code = 204 uri = /eip-gateways
25622024-11-14T00:26:53.700ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
25632024-11-14T00:26:53.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43766 req_id = 8028ddbd-57b8-45e1-8f4d-239b5d958dba response_code = 204 uri = /eip-gateways
25642024-11-14T00:26:53.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43766 req_id = b8326f32-c24d-4126-89d7-9326caf72df2 response_code = 204 uri = /vpc-routes
25652024-11-14T00:26:53.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
25662024-11-14T00:26:53.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40925 req_id = 207c36db-47e8-483f-8006-8e5fc37260a5 response_code = 204 uri = /eip-gateways
25672024-11-14T00:26:53.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37157
25682024-11-14T00:26:53.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37157 req_id = ceccff0f-788f-46eb-b939-dc922e32aeb1 response_code = 200 uri = /v2p
25692024-11-14T00:26:53.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40925 req_id = 1a80184e-54f4-43f2-80df-4a7ba67c9b9a response_code = 204 uri = /vpc-routes
25702024-11-14T00:26:53.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50492 req_id = ae41b760-404b-4443-9eb4-586e7893a1a0 response_code = 204 uri = /vpc-routes
25712024-11-14T00:26:53.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49949
25722024-11-14T00:26:53.742ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25732024-11-14T00:26:53.782ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25742024-11-14T00:26:53.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49949 req_id = b1346c97-f0b4-4e27-a18c-bc017a124c97 response_code = 204 uri = /switch-ports
25752024-11-14T00:26:53.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56464
25762024-11-14T00:26:53.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51496
25772024-11-14T00:26:53.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42067
25782024-11-14T00:26:53.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49949 req_id = 20b7a369-e4d5-4338-9383-29b9dad0adb0 response_code = 200 uri = /network-bootstore-config
25792024-11-14T00:26:53.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25802024-11-14T00:26:53.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56464 req_id = 6f29f85e-4cbe-42f9-b0ee-5a12f61f254c response_code = 200 uri = /v2p
25812024-11-14T00:26:53.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51496 req_id = 82c8b362-3f44-464d-881c-24054de3b759 response_code = 200 uri = /v2p
25822024-11-14T00:26:53.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25832024-11-14T00:26:53.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98497 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42067 req_id = f8a05cb5-17f4-4125-a389-871d8056568f response_code = 204 uri = /switch-ports
25842024-11-14T00:26:53.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42067 req_id = 9bc581b0-1669-4b02-b3c3-1889bb106d3c response_code = 200 uri = /network-bootstore-config
25852024-11-14T00:26:54.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53002
25862024-11-14T00:26:54.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25872024-11-14T00:26:54.040ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25882024-11-14T00:26:54.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97129 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53002 req_id = 5c9963e5-ff9e-4e47-b243-0b49b0282ded response_code = 204 uri = /switch-ports
25892024-11-14T00:26:54.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53002 req_id = 0a2252af-a908-48b5-a29d-665b0c0c852e response_code = 200 uri = /network-bootstore-config
25902024-11-14T00:27:01.151ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25912024-11-14T00:27:01.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25922024-11-14T00:27:11.151ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25932024-11-14T00:27:11.152ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25942024-11-14T00:27:11.154ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25952024-11-14T00:27:11.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25962024-11-14T00:27:21.153ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25972024-11-14T00:27:21.154ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25982024-11-14T00:27:21.156ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
25992024-11-14T00:27:21.332ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26002024-11-14T00:27:23.408ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52659
26012024-11-14T00:27:23.408ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52659 req_id = b9fab492-dbfa-4447-950a-6f427b181818 response_code = 200 uri = /baseboard
26022024-11-14T00:27:23.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59387
26032024-11-14T00:27:23.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59387 req_id = 8d8d24c9-07f6-4626-ba0d-725d614102a1 response_code = 200 uri = /vpc-routes
26042024-11-14T00:27:23.462ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
26052024-11-14T00:27:23.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59387 req_id = 17b1bad4-4e8e-4dfc-ad25-5c2e8f82cbb7 response_code = 204 uri = /eip-gateways
26062024-11-14T00:27:23.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59387 req_id = 4d4ec16b-b912-4abb-b4a7-10d78fe1f48d response_code = 204 uri = /vpc-routes
26072024-11-14T00:27:23.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46036
26082024-11-14T00:27:23.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46036 req_id = c7361c27-75cf-452b-959c-7cf668549aad response_code = 200 uri = /vpc-routes
26092024-11-14T00:27:23.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47531
26102024-11-14T00:27:23.513ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26112024-11-14T00:27:23.566ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26122024-11-14T00:27:23.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47531 req_id = cd3d50bf-eb90-4df7-a60e-9a6c4f764061 response_code = 204 uri = /switch-ports
26132024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63883
26142024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50480
26152024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49439
26162024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41491
26172024-11-14T00:27:23.641ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
26182024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46036 req_id = 5bfb8960-adbb-4947-ba84-9566273130d4 response_code = 204 uri = /eip-gateways
26192024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63883 req_id = 5eb38296-af74-4def-a300-c6f7979fc04f response_code = 200 uri = /vpc-routes
26202024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 406 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47531 req_id = 1832219b-0651-4e4d-89fd-aa3567bc2635 response_code = 200 uri = /network-bootstore-config
26212024-11-14T00:27:23.641ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26222024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41491 req_id = 6117f20e-2c80-4840-8a16-5bca06221101 response_code = 200 uri = /v2p
26232024-11-14T00:27:23.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50480 req_id = 470e986e-8b96-4cf7-9b6b-bc0117becfc8 response_code = 200 uri = /v2p
26242024-11-14T00:27:23.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46036 req_id = 430ce840-0317-4ce9-99ee-fd44ae24b1fc response_code = 204 uri = /vpc-routes
26252024-11-14T00:27:23.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32842
26262024-11-14T00:27:23.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32842 req_id = 7bc7a38d-1272-4b7e-ae3a-d9679c87fcd8 response_code = 200 uri = /v2p
26272024-11-14T00:27:23.687ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26282024-11-14T00:27:23.731ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
26292024-11-14T00:27:23.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63883 req_id = 9f63e6b0-7cd9-4973-ae95-ef4a420825fd response_code = 204 uri = /eip-gateways
26302024-11-14T00:27:23.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 822 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63883 req_id = b2a519f5-3ac6-4efd-bcc7-e4cf41097d40 response_code = 204 uri = /vpc-routes
26312024-11-14T00:27:23.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109082 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49439 req_id = 223f61cd-507e-47e2-a844-e4df841a9c13 response_code = 204 uri = /switch-ports
26322024-11-14T00:27:23.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49439 req_id = 708c6903-4e36-42da-acf2-0bec7e050968 response_code = 200 uri = /network-bootstore-config
26332024-11-14T00:27:23.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35494
26342024-11-14T00:27:23.759ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26352024-11-14T00:27:23.794ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26362024-11-14T00:27:23.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89402 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35494 req_id = 27b4dfd9-aa08-4127-bcf8-7a208fb7c3e5 response_code = 204 uri = /switch-ports
26372024-11-14T00:27:23.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35494 req_id = d859e400-c0b2-42fe-9e45-ed4fc9e2aaed response_code = 200 uri = /network-bootstore-config
26382024-11-14T00:27:31.156ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26392024-11-14T00:27:31.157ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26402024-11-14T00:27:31.159ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26412024-11-14T00:27:31.334ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26422024-11-14T00:27:41.159ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26432024-11-14T00:27:41.160ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26442024-11-14T00:27:41.161ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26452024-11-14T00:27:41.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26462024-11-14T00:27:51.161ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26472024-11-14T00:27:51.162ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26482024-11-14T00:27:51.163ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26492024-11-14T00:27:51.337ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26502024-11-14T00:27:53.455ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55169
26512024-11-14T00:27:53.455ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55169 req_id = 4e5c4135-f295-471e-9c8c-adf5200629f4 response_code = 200 uri = /baseboard
26522024-11-14T00:27:53.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58564
26532024-11-14T00:27:53.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58564 req_id = 0af47737-6e64-426a-99ad-3952596e7e5b response_code = 200 uri = /vpc-routes
26542024-11-14T00:27:53.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
26552024-11-14T00:27:53.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58564 req_id = f02dba20-1657-4dd8-a687-b662cea010d7 response_code = 204 uri = /eip-gateways
26562024-11-14T00:27:53.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51531
26572024-11-14T00:27:53.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51531 req_id = cb7442c2-2c59-4204-a454-c1847a62d93e response_code = 200 uri = /v2p
26582024-11-14T00:27:53.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58564 req_id = f2a86b1e-9cf9-4d16-8cdd-40ac8fdc3ffd response_code = 204 uri = /vpc-routes
26592024-11-14T00:27:53.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54017
26602024-11-14T00:27:53.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54017 req_id = 59df3a2d-8af8-42e7-a714-abddbe58feeb response_code = 200 uri = /vpc-routes
26612024-11-14T00:27:53.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43935
26622024-11-14T00:27:53.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43935 req_id = df7f5b4f-8a43-46ca-b671-d99bafa04508 response_code = 200 uri = /vpc-routes
26632024-11-14T00:27:53.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50864
26642024-11-14T00:27:53.718ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26652024-11-14T00:27:53.768ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26662024-11-14T00:27:53.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50864 req_id = ccfc3a79-a1ec-446c-9eeb-0c42cdcdcbb0 response_code = 204 uri = /switch-ports
26672024-11-14T00:27:53.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35148
26682024-11-14T00:27:53.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
26692024-11-14T00:27:53.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43935 req_id = 883186dc-4ea4-45f6-84de-800136b8ceb1 response_code = 204 uri = /eip-gateways
26702024-11-14T00:27:53.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38013
26712024-11-14T00:27:53.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
26722024-11-14T00:27:53.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54017 req_id = ebf351e0-8ddf-4964-911b-7246d7edf4ef response_code = 204 uri = /eip-gateways
26732024-11-14T00:27:53.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50864 req_id = 3daa2f93-f81e-479a-bb86-e38ee8a05366 response_code = 200 uri = /network-bootstore-config
26742024-11-14T00:27:53.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35148 req_id = 5c57104d-29c7-4c00-81ce-d821e979108a response_code = 200 uri = /v2p
26752024-11-14T00:27:53.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26762024-11-14T00:27:53.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54017 req_id = ccd13741-c11d-4884-ba64-9e11ab77d5bb response_code = 204 uri = /vpc-routes
26772024-11-14T00:27:53.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26782024-11-14T00:27:53.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38013 req_id = 17601412-5599-486c-8636-28c1746143c3 response_code = 204 uri = /switch-ports
26792024-11-14T00:27:53.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38013 req_id = 4c12ebfc-21ed-4c84-8f5e-4be6590b26c9 response_code = 200 uri = /network-bootstore-config
26802024-11-14T00:27:53.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36013
26812024-11-14T00:27:53.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36013 req_id = fe542222-01ae-4722-a0fb-71a75232aaa2 response_code = 200 uri = /v2p
26822024-11-14T00:27:53.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43935 req_id = 14c12282-f5e4-4467-a81d-45d84fb924fc response_code = 204 uri = /vpc-routes
26832024-11-14T00:27:54.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64757
26842024-11-14T00:27:54.007ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26852024-11-14T00:27:54.046ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26862024-11-14T00:27:54.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64757 req_id = 719b4711-0197-4625-9401-7127d25e3c7c response_code = 204 uri = /switch-ports
26872024-11-14T00:27:54.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64757 req_id = 31cc1d2d-639e-4a69-97a3-49bbd8b24aec response_code = 200 uri = /network-bootstore-config
26882024-11-14T00:28:01.163ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26892024-11-14T00:28:01.164ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26902024-11-14T00:28:01.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26912024-11-14T00:28:01.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26922024-11-14T00:28:11.164ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26932024-11-14T00:28:11.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26942024-11-14T00:28:11.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26952024-11-14T00:28:11.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26962024-11-14T00:28:21.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26972024-11-14T00:28:21.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26982024-11-14T00:28:21.169ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
26992024-11-14T00:28:21.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27002024-11-14T00:28:23.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36055
27012024-11-14T00:28:23.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36055 req_id = a3e9fe24-4f86-4ac3-ae7b-b835c8be9cd4 response_code = 200 uri = /vpc-routes
27022024-11-14T00:28:23.380ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
27032024-11-14T00:28:23.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36055 req_id = 8c16a5a8-bee5-4d0c-97ab-b840b6820d2f response_code = 204 uri = /eip-gateways
27042024-11-14T00:28:23.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36055 req_id = 78e02e91-1189-4d3d-967d-24f9adc6ab97 response_code = 204 uri = /vpc-routes
27052024-11-14T00:28:23.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43444
27062024-11-14T00:28:23.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43444 req_id = 777e5a50-5024-43ae-b4fd-d1b8efd8ffe7 response_code = 200 uri = /vpc-routes
27072024-11-14T00:28:23.425ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
27082024-11-14T00:28:23.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43444 req_id = f460bc1d-548f-4835-a382-0c406d31219c response_code = 204 uri = /eip-gateways
27092024-11-14T00:28:23.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43444 req_id = cf49beaf-7be4-4cc8-8e60-cdd96bb02e2e response_code = 204 uri = /vpc-routes
27102024-11-14T00:28:23.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61646
27112024-11-14T00:28:23.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61646 req_id = 44eacada-4fb1-47b4-bfed-da7612e72051 response_code = 200 uri = /v2p
27122024-11-14T00:28:23.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45031
27132024-11-14T00:28:23.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45031 req_id = f537bc06-201a-418a-ba6c-381742cf5a8d response_code = 200 uri = /v2p
27142024-11-14T00:28:23.500ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58886
27152024-11-14T00:28:23.500ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58886 req_id = ccb30fc4-8d00-48d6-9dfe-a95052479ec1 response_code = 200 uri = /baseboard
27162024-11-14T00:28:23.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34306
27172024-11-14T00:28:23.528ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27182024-11-14T00:28:23.576ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27192024-11-14T00:28:23.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113519 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34306 req_id = 4117f57a-7bb7-4087-b6f7-e7bf71ab2cab response_code = 204 uri = /switch-ports
27202024-11-14T00:28:23.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49197
27212024-11-14T00:28:23.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38234
27222024-11-14T00:28:23.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38234 req_id = b28ea559-2530-4d75-9c33-e6f0015cb37c response_code = 200 uri = /vpc-routes
27232024-11-14T00:28:23.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34306 req_id = eeb9bc15-292c-4cc1-a413-cc59fb25c0bf response_code = 200 uri = /network-bootstore-config
27242024-11-14T00:28:23.642ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27252024-11-14T00:28:23.662ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
27262024-11-14T00:28:23.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 549 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38234 req_id = 393be7e9-0f17-4445-af5d-1df1372e4d0b response_code = 204 uri = /eip-gateways
27272024-11-14T00:28:23.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27282024-11-14T00:28:23.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65397
27292024-11-14T00:28:23.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65397 req_id = 24aef424-e298-483c-aed1-6065d9fe2f2a response_code = 200 uri = /v2p
27302024-11-14T00:28:23.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38234 req_id = 482b4ebd-5d1c-4c48-8fe0-41ee4c9d3fea response_code = 204 uri = /vpc-routes
27312024-11-14T00:28:23.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51089
27322024-11-14T00:28:23.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27332024-11-14T00:28:23.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49197 req_id = ee74f621-f7d4-43ed-8f2c-799c13b12cdb response_code = 204 uri = /switch-ports
27342024-11-14T00:28:23.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 569 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49197 req_id = f9b0f37b-a626-437b-9737-eb41b61a83e1 response_code = 200 uri = /network-bootstore-config
27352024-11-14T00:28:23.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27362024-11-14T00:28:23.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51089 req_id = de5e4a1a-0b22-46f7-bff2-e6a956a14ebe response_code = 204 uri = /switch-ports
27372024-11-14T00:28:23.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51089 req_id = d20145ad-9a88-4501-8874-392450f900b1 response_code = 200 uri = /network-bootstore-config
27382024-11-14T00:28:31.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27392024-11-14T00:28:31.170ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27402024-11-14T00:28:31.172ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27412024-11-14T00:28:31.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27422024-11-14T00:28:41.170ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27432024-11-14T00:28:41.172ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27442024-11-14T00:28:41.173ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27452024-11-14T00:28:41.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27462024-11-14T00:28:51.173ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27472024-11-14T00:28:51.174ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27482024-11-14T00:28:51.175ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27492024-11-14T00:28:51.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
27502024-11-14T00:28:53.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55964
27512024-11-14T00:28:53.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55964 req_id = e93b0df7-cefc-4707-b50c-ca3c19fad027 response_code = 200 uri = /vpc-routes
27522024-11-14T00:28:53.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
27532024-11-14T00:28:53.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55964 req_id = 4e51cbaf-5a3b-4f3b-9d91-590799f79bc0 response_code = 204 uri = /eip-gateways
27542024-11-14T00:28:53.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32861
27552024-11-14T00:28:53.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32861 req_id = 8797e7e2-0ef3-4612-add1-5b469de53b85 response_code = 200 uri = /vpc-routes
27562024-11-14T00:28:53.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55964 req_id = c08a9332-ca1b-4c9f-aac0-60f83f958469 response_code = 204 uri = /vpc-routes
27572024-11-14T00:28:53.570ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44832
27582024-11-14T00:28:53.570ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44832 req_id = 3904879e-98c2-4241-ad95-056c3e1b1e22 response_code = 200 uri = /baseboard
27592024-11-14T00:28:53.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
27602024-11-14T00:28:53.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32861 req_id = c536d663-7521-412e-aeb4-be39505e7fa3 response_code = 204 uri = /eip-gateways
27612024-11-14T00:28:53.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32861 req_id = c140656a-5680-4764-b376-cd576bfae62f response_code = 204 uri = /vpc-routes
27622024-11-14T00:28:53.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45906
27632024-11-14T00:28:53.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45906 req_id = b3e9e26f-7720-4946-af95-1932ad149adf response_code = 200 uri = /v2p
27642024-11-14T00:28:53.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38572
27652024-11-14T00:28:53.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38572 req_id = 4b4dc018-2c76-4a57-8f82-694a221f0034 response_code = 200 uri = /vpc-routes
27662024-11-14T00:28:53.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60244
27672024-11-14T00:28:53.832ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27682024-11-14T00:28:53.874ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27692024-11-14T00:28:53.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60244 req_id = 56f94e73-64c6-4aae-873a-456e8dddb643 response_code = 204 uri = /switch-ports
27702024-11-14T00:28:53.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56326
27712024-11-14T00:28:53.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
27722024-11-14T00:28:53.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38572 req_id = 04bae614-f8a8-4f84-8912-b3777ac40705 response_code = 204 uri = /eip-gateways
27732024-11-14T00:28:53.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43390
27742024-11-14T00:28:53.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53346
27752024-11-14T00:28:53.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56326 req_id = 9381c9d3-8a22-45c5-af12-08f735d76611 response_code = 200 uri = /v2p
27762024-11-14T00:28:53.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60244 req_id = 161e3c1c-e3f4-44d2-99c0-bd045fb89dac response_code = 200 uri = /network-bootstore-config
27772024-11-14T00:28:53.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27782024-11-14T00:28:53.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27792024-11-14T00:28:53.930ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27802024-11-14T00:28:53.930ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
27812024-11-14T00:28:53.937ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
27822024-11-14T00:28:53.952ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27832024-11-14T00:28:53.952ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3
27842024-11-14T00:28:53.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49845
27852024-11-14T00:28:53.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56626
27862024-11-14T00:28:53.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56626 req_id = 525b3121-0d76-44b2-929a-6d8739247e03 response_code = 200 uri = /v2p
27872024-11-14T00:28:53.959ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27882024-11-14T00:28:53.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27892024-11-14T00:28:53.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27902024-11-14T00:28:53.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27912024-11-14T00:28:53.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27922024-11-14T00:28:53.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27932024-11-14T00:28:53.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27942024-11-14T00:28:53.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 545 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49845 req_id = 798f0908-8360-460d-a4ef-9489a090081b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27952024-11-14T00:28:53.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 921 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38572 req_id = 83364301-f84a-46fd-8816-65a0d9a2bcf5 response_code = 204 uri = /vpc-routes
27962024-11-14T00:28:53.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58689
27972024-11-14T00:28:53.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27982024-11-14T00:28:53.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27992024-11-14T00:28:53.972ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
28002024-11-14T00:28:53.978ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
28012024-11-14T00:28:53.978ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28022024-11-14T00:28:53.989ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28032024-11-14T00:28:53.989ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5d197ef6-7d58-4152-8a63-88374989a904
28042024-11-14T00:28:53.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44488
28052024-11-14T00:28:54.009ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28062024-11-14T00:28:54.009ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3
28072024-11-14T00:28:54.042ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28082024-11-14T00:28:54.042ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5d197ef6-7d58-4152-8a63-88374989a904
28092024-11-14T00:28:54.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35285
28102024-11-14T00:28:54.061ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28112024-11-14T00:28:54.061ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272
28122024-11-14T00:28:54.066ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28132024-11-14T00:28:54.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136240 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53346 req_id = a3340b85-ea9c-44d3-9cee-0f04a7ce4f1f response_code = 204 uri = /switch-ports
28142024-11-14T00:28:54.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6605 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53346 req_id = d6561acc-ba49-434e-b8bb-782660ebab31 response_code = 200 uri = /network-bootstore-config
28152024-11-14T00:28:54.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28162024-11-14T00:28:54.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28172024-11-14T00:28:54.079ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/config/omicron-zones.json file = common/src/ledger.rs:177
28182024-11-14T00:28:54.084ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28192024-11-14T00:28:54.084ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272
28202024-11-14T00:28:54.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47419
28212024-11-14T00:28:54.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48094
28222024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28232024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28242024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28252024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28262024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28272024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28282024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28292024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28302024-11-14T00:28:54.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 590 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47419 req_id = 4d5bc929-d922-4855-9e8a-4a0e3c939f4f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28312024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28322024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28332024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28342024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28352024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28362024-11-14T00:28:54.096ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28372024-11-14T00:28:54.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 717 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48094 req_id = bcdb21fd-878c-4ad6-8b13-eb12a51c2ad0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28382024-11-14T00:28:54.098ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/config/omicron-zones.json file = common/src/ledger.rs:177
28392024-11-14T00:28:54.102ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28402024-11-14T00:28:54.102ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a
28412024-11-14T00:28:54.119ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2131892-f7b5-4e6d-b374-d80d9e2c92a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28422024-11-14T00:28:54.119ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2131892-f7b5-4e6d-b374-d80d9e2c92a3
28432024-11-14T00:28:54.122ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28442024-11-14T00:28:54.137ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28452024-11-14T00:28:54.138ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a
28462024-11-14T00:28:54.157ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d197ef6-7d58-4152-8a63-88374989a904 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28472024-11-14T00:28:54.157ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5d197ef6-7d58-4152-8a63-88374989a904
28482024-11-14T00:28:54.171ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28492024-11-14T00:28:54.171ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da3c518e-c769-471a-bde6-cca14456f7ec
28502024-11-14T00:28:54.188ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28512024-11-14T00:28:54.188ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da3c518e-c769-471a-bde6-cca14456f7ec
28522024-11-14T00:28:54.204ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28532024-11-14T00:28:54.204ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12
28542024-11-14T00:28:54.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44488 req_id = c70e8fc9-ccde-4eac-b2de-c71095dc74dc response_code = 204 uri = /switch-ports
28552024-11-14T00:28:54.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44488 req_id = 872de624-6d77-45a5-bc85-10904f46281a response_code = 200 uri = /network-bootstore-config
28562024-11-14T00:28:54.217ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c2753ec7-decb-4fc2-b85a-bb303a9a0272 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28572024-11-14T00:28:54.217ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c2753ec7-decb-4fc2-b85a-bb303a9a0272
28582024-11-14T00:28:54.236ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28592024-11-14T00:28:54.236ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12
28602024-11-14T00:28:54.251ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 611c0d1f-c3e5-4b0f-a639-5014001f214a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28612024-11-14T00:28:54.252ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_611c0d1f-c3e5-4b0f-a639-5014001f214a
28622024-11-14T00:28:54.264ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28632024-11-14T00:28:54.264ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e6e03840-7feb-4068-8c49-369b714d0403
28642024-11-14T00:28:54.280ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28652024-11-14T00:28:54.280ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e6e03840-7feb-4068-8c49-369b714d0403
28662024-11-14T00:28:54.293ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28672024-11-14T00:28:54.293ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b
28682024-11-14T00:28:54.305ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da3c518e-c769-471a-bde6-cca14456f7ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28692024-11-14T00:28:54.305ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da3c518e-c769-471a-bde6-cca14456f7ec
28702024-11-14T00:28:54.320ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28712024-11-14T00:28:54.321ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b
28722024-11-14T00:28:54.334ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: add8768e-2165-4e64-8dd1-e83d8eef6e12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28732024-11-14T00:28:54.334ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_add8768e-2165-4e64-8dd1-e83d8eef6e12
28742024-11-14T00:28:54.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28752024-11-14T00:28:54.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003
28762024-11-14T00:28:54.362ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28772024-11-14T00:28:54.362ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003
28782024-11-14T00:28:54.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 437741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43390 req_id = 1d17cb0c-5950-4e9c-9ca3-3c28055398ea response_code = 200 uri = /inventory
28792024-11-14T00:28:54.376ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6e03840-7feb-4068-8c49-369b714d0403 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28802024-11-14T00:28:54.376ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e6e03840-7feb-4068-8c49-369b714d0403
28812024-11-14T00:28:54.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 422321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58689 req_id = ffa94d32-c20d-4aed-8ef6-487729c3279b response_code = 200 uri = /inventory
28822024-11-14T00:28:54.398ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 933f54ba-53f6-4fc4-85d7-b34c2047f65b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28832024-11-14T00:28:54.398ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_933f54ba-53f6-4fc4-85d7-b34c2047f65b
28842024-11-14T00:28:54.419ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f7e9522-4b31-4c16-8c06-cd2c5c5e5003 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28852024-11-14T00:28:54.419ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f7e9522-4b31-4c16-8c06-cd2c5c5e5003
28862024-11-14T00:28:54.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 372151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35285 req_id = df47b9de-7ebf-4057-b57a-fb2ccc42947b response_code = 200 uri = /inventory
28872024-11-14T00:29:01.175ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28882024-11-14T00:29:01.175ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28892024-11-14T00:29:01.177ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28902024-11-14T00:29:01.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28912024-11-14T00:29:11.177ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28922024-11-14T00:29:11.178ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28932024-11-14T00:29:11.179ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28942024-11-14T00:29:11.351ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28952024-11-14T00:29:21.178ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28962024-11-14T00:29:21.179ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28972024-11-14T00:29:21.182ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28982024-11-14T00:29:21.353ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
28992024-11-14T00:29:23.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47120
29002024-11-14T00:29:23.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47120 req_id = 2acec62f-dead-44a1-9c3d-c2ac6da22720 response_code = 200 uri = /vpc-routes
29012024-11-14T00:29:23.383ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
29022024-11-14T00:29:23.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47120 req_id = 3366e9c2-33ac-4c57-a8a7-b12f1649997c response_code = 204 uri = /eip-gateways
29032024-11-14T00:29:23.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47120 req_id = 5d5f7d6d-7744-4bb8-8166-7a2da2542222 response_code = 204 uri = /vpc-routes
29042024-11-14T00:29:23.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53426
29052024-11-14T00:29:23.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53426 req_id = d78379dc-bba1-4cad-8dc7-116004215fdf response_code = 200 uri = /vpc-routes
29062024-11-14T00:29:23.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
29072024-11-14T00:29:23.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53426 req_id = 3d2192ba-5b8e-480e-ad0f-6ac133d37bbc response_code = 204 uri = /eip-gateways
29082024-11-14T00:29:23.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52569
29092024-11-14T00:29:23.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29102024-11-14T00:29:23.529ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29112024-11-14T00:29:23.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116710 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52569 req_id = 1aff5c36-1a2c-4886-b141-78aa1c1f1d6d response_code = 204 uri = /switch-ports
29122024-11-14T00:29:23.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55690
29132024-11-14T00:29:23.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39166
29142024-11-14T00:29:23.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65398
29152024-11-14T00:29:23.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53426 req_id = 13c51425-c1b8-47bd-ab2b-6959ff9c43be response_code = 204 uri = /vpc-routes
29162024-11-14T00:29:23.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52569 req_id = 2f32d722-8131-4086-a1c9-16487af1c193 response_code = 200 uri = /network-bootstore-config
29172024-11-14T00:29:23.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65398 req_id = 9aa32c78-181c-4bb1-9315-b69564dd8448 response_code = 200 uri = /vpc-routes
29182024-11-14T00:29:23.598ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29192024-11-14T00:29:23.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55690 req_id = ffbb9186-9c3d-44fc-9eff-d30202349e5a response_code = 200 uri = /v2p
29202024-11-14T00:29:23.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49950
29212024-11-14T00:29:23.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49950 req_id = ef609029-fc63-47e4-bad1-509fc152c0ed response_code = 200 uri = /v2p
29222024-11-14T00:29:23.606ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52884
29232024-11-14T00:29:23.606ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52884 req_id = 243f4104-1c57-4a86-949a-185a0f91ad2c response_code = 200 uri = /baseboard
29242024-11-14T00:29:23.613ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
29252024-11-14T00:29:23.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65398 req_id = d07027fa-161a-4545-897d-3b35a2e390ec response_code = 204 uri = /eip-gateways
29262024-11-14T00:29:23.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64979
29272024-11-14T00:29:23.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64979 req_id = c5052f03-9974-4faf-add4-c8642a15b927 response_code = 200 uri = /v2p
29282024-11-14T00:29:23.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65398 req_id = 6911566a-d87b-4283-ad58-68f58598540c response_code = 204 uri = /vpc-routes
29292024-11-14T00:29:23.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29302024-11-14T00:29:23.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44931
29312024-11-14T00:29:23.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97438 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39166 req_id = fd6881dd-0a06-4f6c-9505-e0d9fff288b2 response_code = 204 uri = /switch-ports
29322024-11-14T00:29:23.695ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29332024-11-14T00:29:23.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 734 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39166 req_id = 2676e6a3-5967-4764-a96e-6785cfd75759 response_code = 200 uri = /network-bootstore-config
29342024-11-14T00:29:23.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29352024-11-14T00:29:23.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44931 req_id = 7142eb07-3c25-41b6-b4a6-f788933da600 response_code = 204 uri = /switch-ports
29362024-11-14T00:29:23.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44931 req_id = 04bd5db8-7d4f-448e-9f1a-dc63152a92b2 response_code = 200 uri = /network-bootstore-config
29372024-11-14T00:29:31.182ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29382024-11-14T00:29:31.183ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29392024-11-14T00:29:31.184ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29402024-11-14T00:29:31.355ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29412024-11-14T00:29:41.184ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29422024-11-14T00:29:41.185ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29432024-11-14T00:29:41.187ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29442024-11-14T00:29:41.358ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29452024-11-14T00:29:45.431ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
29462024-11-14T00:29:51.186ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29472024-11-14T00:29:51.187ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29482024-11-14T00:29:51.188ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29492024-11-14T00:29:51.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
29502024-11-14T00:29:53.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37827
29512024-11-14T00:29:53.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37827 req_id = 37586939-8505-4e55-8e68-020784e37bdf response_code = 200 uri = /vpc-routes
29522024-11-14T00:29:53.542ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
29532024-11-14T00:29:53.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37827 req_id = 9fabea89-ad62-418d-ac30-0dd1b450ee04 response_code = 204 uri = /eip-gateways
29542024-11-14T00:29:53.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37827 req_id = e322f9b8-cc24-49e9-8918-7b546d5a8815 response_code = 204 uri = /vpc-routes
29552024-11-14T00:29:53.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46301
29562024-11-14T00:29:53.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46301 req_id = c291c11a-a375-4da4-8267-7118b82a626a response_code = 200 uri = /v2p
29572024-11-14T00:29:53.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64205
29582024-11-14T00:29:53.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29592024-11-14T00:29:53.673ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29602024-11-14T00:29:53.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112595 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64205 req_id = b1a2393a-5e58-42f0-a10a-cff5b828778e response_code = 204 uri = /switch-ports
29612024-11-14T00:29:53.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60241
29622024-11-14T00:29:53.743ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52457
29632024-11-14T00:29:53.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57859
29642024-11-14T00:29:53.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54518
29652024-11-14T00:29:53.743ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52457 req_id = d8580976-9685-4de2-a7dd-0aca97e3361d response_code = 200 uri = /baseboard
29662024-11-14T00:29:53.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64205 req_id = e1eb573e-22ce-42a8-b5a1-c52e6e5c1f81 response_code = 200 uri = /network-bootstore-config
29672024-11-14T00:29:53.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54518 req_id = 783af5c8-c169-4bc4-8384-49bb023101d0 response_code = 200 uri = /vpc-routes
29682024-11-14T00:29:53.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60241 req_id = 23f19d91-d9b5-4b61-8209-c6837fd915bb response_code = 200 uri = /vpc-routes
29692024-11-14T00:29:53.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57859 req_id = 326bf6f4-82f9-429e-8e4b-78847383ce08 response_code = 200 uri = /v2p
29702024-11-14T00:29:53.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59981
29712024-11-14T00:29:53.766ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29722024-11-14T00:29:53.810ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29732024-11-14T00:29:53.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112069 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59981 req_id = 365b7b11-4b48-4ea4-ada9-16fb7fd842f0 response_code = 204 uri = /switch-ports
29742024-11-14T00:29:53.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
29752024-11-14T00:29:53.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54518 req_id = 3b8fff41-829e-47a4-b792-d29334a2906b response_code = 204 uri = /eip-gateways
29762024-11-14T00:29:53.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
29772024-11-14T00:29:53.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60241 req_id = 43973fb4-dec6-46a2-b704-31d74dfe2042 response_code = 204 uri = /eip-gateways
29782024-11-14T00:29:53.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59981 req_id = 14bc1a01-0183-4cb5-8471-488b84fd0177 response_code = 200 uri = /network-bootstore-config
29792024-11-14T00:29:53.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60241 req_id = e08cd2f2-419b-4603-b863-322851f8f3e5 response_code = 204 uri = /vpc-routes
29802024-11-14T00:29:53.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54518 req_id = 4f95e4f3-2839-4814-b0e9-8e159be7915c response_code = 204 uri = /vpc-routes
29812024-11-14T00:29:53.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54402
29822024-11-14T00:29:53.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54402 req_id = c2e14d13-e277-4557-a259-8ccb2c4243fa response_code = 200 uri = /v2p
29832024-11-14T00:29:53.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54791
29842024-11-14T00:29:53.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29852024-11-14T00:29:53.997ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29862024-11-14T00:29:54.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116223 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54791 req_id = 98228cf0-fd5d-4a12-bfe1-958f3400b9d1 response_code = 204 uri = /switch-ports
29872024-11-14T00:29:54.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54791 req_id = 44f37dbc-d77d-4372-8c12-14b6221aba6e response_code = 200 uri = /network-bootstore-config
29882024-11-14T00:29:57.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52418
29892024-11-14T00:29:57.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52418 req_id = 7640b966-bee4-4e63-906c-227465b8c281 response_code = 200 uri = /v2p
29902024-11-14T00:29:57.401ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4220214) }
29912024-11-14T00:29:57.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52418 req_id = 6d256973-1014-4378-a171-d6e22385c3d7 response_code = 204 uri = /v2p
29922024-11-14T00:29:57.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38809
29932024-11-14T00:29:57.496ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 67f3c760-5a98-459f-a5c8-5c06655ef0fe, kind: Instance { id: e21ef448-9c04-42c3-96f9-7b85864c1212 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4220214), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67f3c760-5a98-459f-a5c8-5c06655ef0fe, kind: Instance { id: e21ef448-9c04-42c3-96f9-7b85864c1212 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4220214), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67f3c760-5a98-459f-a5c8-5c06655ef0fe, kind: Instance { id: e21ef448-9c04-42c3-96f9-7b85864c1212 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4220214), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4220214))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67f3c760-5a98-459f-a5c8-5c06655ef0fe, kind: Instance { id: e21ef448-9c04-42c3-96f9-7b85864c1212 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4220214), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-c10d2442f44", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 64ab900b-4058-4c6e-9b6e-5704580f39a6, read_only_parent: Some(Volume { block_size: 512, id: 8e25304a-74ef-4230-a2ef-0c2f7eeacef0, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: bfa917af-b827-40aa-8193-114fd98c5394, key: Some("pa2/NMVB/3gnBV592w/DGNUejl+vSiShR9Y+ZPlPBAg="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 64ab900b-4058-4c6e-9b6e-5704580f39a6, key: Some("Jnp20y9ya0y89ceqj1FbYsmnpRHGD1onZeqN/U6QaGM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::14]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-c10d2442f44" }] }), cloud_init_bytes: Some(..) } instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 metadata = InstanceMetadata { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, project_id: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T00:29:57.491065847Z }
29942024-11-14T00:29:57.496ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 migration_id = None propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
29952024-11-14T00:29:57.496ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 migration_id = None propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 67f3c760-5a98-459f-a5c8-5c06655ef0fe, kind: Instance { id: e21ef448-9c04-42c3-96f9-7b85864c1212 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4220214), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67f3c760-5a98-459f-a5c8-5c06655ef0fe, kind: Instance { id: e21ef448-9c04-42c3-96f9-7b85864c1212 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4220214), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67f3c760-5a98-459f-a5c8-5c06655ef0fe, kind: Instance { id: e21ef448-9c04-42c3-96f9-7b85864c1212 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4220214), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4220214))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67f3c760-5a98-459f-a5c8-5c06655ef0fe, kind: Instance { id: e21ef448-9c04-42c3-96f9-7b85864c1212 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4220214), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-c10d2442f44", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 64ab900b-4058-4c6e-9b6e-5704580f39a6, read_only_parent: Some(Volume { block_size: 512, id: 8e25304a-74ef-4230-a2ef-0c2f7eeacef0, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: bfa917af-b827-40aa-8193-114fd98c5394, key: Some("pa2/NMVB/3gnBV592w/DGNUejl+vSiShR9Y+ZPlPBAg="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 64ab900b-4058-4c6e-9b6e-5704580f39a6, key: Some("Jnp20y9ya0y89ceqj1FbYsmnpRHGD1onZeqN/U6QaGM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::14]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-c10d2442f44" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T00:29:57.491065847Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29962024-11-14T00:29:57.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5464 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38809 req_id = 4f9a4a7a-0a04-4d6c-8823-1eb2b57c911a response_code = 200 uri = /vmms/74827a84-0484-483d-b883-f1f6670c5693
29972024-11-14T00:29:57.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52649
29982024-11-14T00:29:57.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52649 req_id = a47968f8-d5fe-4b7b-8257-fecffd6b74cf response_code = 200 uri = /vmms/74827a84-0484-483d-b883-f1f6670c5693/state
29992024-11-14T00:29:57.593ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4220214 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30002024-11-14T00:29:57.593ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30012024-11-14T00:29:57.634ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693 file = illumos-utils/src/zone.rs:325 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30022024-11-14T00:29:57.656ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693 file = illumos-utils/src/zone.rs:363 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30032024-11-14T00:29:57.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60079
30042024-11-14T00:29:57.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60079 req_id = 4d258c18-b5c4-4ac0-a8b9-f24b9c9312f8 response_code = 200 uri = /vpc-routes
30052024-11-14T00:29:57.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {67f3c760-5a98-459f-a5c8-5c06655ef0fe: {10.151.1.176: {5cd95a7a-5161-4989-87c2-490595c65b91}, 10.151.1.175: {5cd95a7a-5161-4989-87c2-490595c65b91}}} }
30062024-11-14T00:29:59.328ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30072024-11-14T00:29:59.328ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693 zone file = illumos-utils/src/running_zone.rs:488 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30082024-11-14T00:29:59.535ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 59.473704ms file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30092024-11-14T00:29:59.617ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 65.52141ms file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30102024-11-14T00:29:59.700ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 286.019693ms file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30112024-11-14T00:30:00.007ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 285.312602ms file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30122024-11-14T00:30:00.310ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 1.176670716s file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30132024-11-14T00:30:01.189ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30142024-11-14T00:30:01.190ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30152024-11-14T00:30:01.192ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30162024-11-14T00:30:01.362ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30172024-11-14T00:30:01.506ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 1.479072263s file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30182024-11-14T00:30:03.003ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 1.436595111s file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30192024-11-14T00:30:04.454ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 1.304032923s file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 zone = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30202024-11-14T00:30:05.788ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693 file = sled-agent/src/instance.rs:1787 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30212024-11-14T00:30:05.798ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 45.990827ms file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30222024-11-14T00:30:05.855ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693") failed: Property not found. retry in 141.11012ms file = illumos-utils/src/svc.rs:36 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30232024-11-14T00:30:06.008ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30242024-11-14T00:30:06.046ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30252024-11-14T00:30:06.184ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30262024-11-14T00:30:06.185ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30272024-11-14T00:30:06.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8500682 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60079 req_id = 6bdd91db-0ac1-432e-9911-adc299e0d6ec response_code = 204 uri = /eip-gateways
30282024-11-14T00:30:06.186ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-14T00:30:06.186156923Z } file = sled-agent/src/instance.rs:780 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30292024-11-14T00:30:06.186ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T00:30:06.186156923Z } propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30302024-11-14T00:30:06.186ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T00:30:06.186156923Z }, migration_in: None, migration_out: None }
30312024-11-14T00:30:06.262ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-14T00:30:06.262471306Z } file = sled-agent/src/instance.rs:780 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30322024-11-14T00:30:06.262ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T00:30:06.262471306Z } propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30332024-11-14T00:30:06.262ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T00:30:06.262471306Z }, migration_in: None, migration_out: None }
30342024-11-14T00:30:06.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60079 req_id = c4ef78b5-173e-4c4f-86ef-344e3db14a82 response_code = 204 uri = /vpc-routes
30352024-11-14T00:30:11.191ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30362024-11-14T00:30:11.192ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30372024-11-14T00:30:11.193ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30382024-11-14T00:30:11.363ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30392024-11-14T00:30:15.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54004
30402024-11-14T00:30:15.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 651 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54004 req_id = 6e82b03c-7eb0-4a6c-994c-2ab5ae9cf29d response_code = 200 uri = /vmms/74827a84-0484-483d-b883-f1f6670c5693/state
30412024-11-14T00:30:15.130ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-14T00:30:15.130515046Z } file = sled-agent/src/instance.rs:780 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30422024-11-14T00:30:15.130ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T00:30:15.130515046Z } propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30432024-11-14T00:30:15.130ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T00:30:15.130515046Z }, migration_in: None, migration_out: None }
30442024-11-14T00:30:15.140ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-14T00:30:15.140594348Z } file = sled-agent/src/instance.rs:780 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30452024-11-14T00:30:15.140ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-14T00:30:15.140594348Z } propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30462024-11-14T00:30:15.140ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30472024-11-14T00:30:15.140ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30482024-11-14T00:30:15.140ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30492024-11-14T00:30:15.141ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/81d2211c-ebdf-4b88-9756-46c1105ccb84/debug/bundle/zone", "/pool/int/eb4b0661-72a7-4ce4-82b1-8d09387e21aa/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/b2131892-f7b5-4e6d-b374-d80d9e2c92a3/crypt/debug", "/pool/ext/5d197ef6-7d58-4152-8a63-88374989a904/crypt/debug", "/pool/ext/c2753ec7-decb-4fc2-b85a-bb303a9a0272/crypt/debug", "/pool/ext/611c0d1f-c3e5-4b0f-a639-5014001f214a/crypt/debug", "/pool/ext/da3c518e-c769-471a-bde6-cca14456f7ec/crypt/debug", "/pool/ext/add8768e-2165-4e64-8dd1-e83d8eef6e12/crypt/debug", "/pool/ext/e6e03840-7feb-4068-8c49-369b714d0403/crypt/debug", "/pool/ext/933f54ba-53f6-4fc4-85d7-b34c2047f65b/crypt/debug", "/pool/ext/4f7e9522-4b31-4c16-8c06-cd2c5c5e5003/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693
30502024-11-14T00:30:15.788ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693", bundle_id: bd1691e0-06ce-48a0-af97-8100ea2aafd0 }, time_created: 2024-11-14T00:30:15.141853435Z, version: 0, cause: TerminatedInstance }
30512024-11-14T00:30:15.788ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_74827a84-0484-483d-b883-f1f6670c5693 file = sled-agent/src/instance.rs:1032 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30522024-11-14T00:30:17.540ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30532024-11-14T00:30:17.557ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(4220214), kind: System }
30542024-11-14T00:30:17.558ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(4220214), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30552024-11-14T00:30:17.558ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T00:30:17.558339600Z }, migration_in: None, migration_out: None }
30562024-11-14T00:30:17.632ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T00:30:17.558339600Z }, migration_in: None, migration_out: None }
30572024-11-14T00:30:17.635ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212 propolis_id = 74827a84-0484-483d-b883-f1f6670c5693
30582024-11-14T00:30:18.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40320
30592024-11-14T00:30:18.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40320 req_id = 6284429a-9be0-44fa-ac17-11e3b4859e8a response_code = 200 uri = /vpc-routes
30602024-11-14T00:30:18.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
30612024-11-14T00:30:18.229ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30622024-11-14T00:30:18.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40320 req_id = 432dc42d-23fb-45ad-b35b-f997cb86b50b response_code = 204 uri = /eip-gateways
30632024-11-14T00:30:18.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40320 req_id = e5844944-f893-4403-8f12-87eb18dd3559 response_code = 204 uri = /vpc-routes
30642024-11-14T00:30:18.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40662
30652024-11-14T00:30:18.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40662 req_id = f61a45ec-afa1-4b31-a980-706a17d8c616 response_code = 200 uri = /v2p
30662024-11-14T00:30:19.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42951
30672024-11-14T00:30:19.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42951 req_id = a3e6cd6b-1fd3-458a-8c1d-bcb0c3496a2d response_code = 200 uri = /v2p
30682024-11-14T00:30:19.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57626
30692024-11-14T00:30:19.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57626 req_id = 83600e14-e0ff-4bca-80a7-10d6d5805735 response_code = 200 uri = /vpc-routes
30702024-11-14T00:30:19.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
30712024-11-14T00:30:19.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57626 req_id = 5f4260a0-ec16-4c92-9a15-88dd0ad805a6 response_code = 204 uri = /eip-gateways
30722024-11-14T00:30:19.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57626 req_id = 69134948-2a50-4a67-91ae-7a62dcb0e663 response_code = 204 uri = /vpc-routes
30732024-11-14T00:30:20.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43192
30742024-11-14T00:30:20.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43192 req_id = a91a6057-83f0-4fa5-874a-c0926ff43cf6 response_code = 200 uri = /vpc-routes
30752024-11-14T00:30:20.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = e211d163-be78-4663-b73f-baf5e9462a10 values = ExternalIpGatewayMap { mappings: {} }
30762024-11-14T00:30:20.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43192 req_id = 6e8b16ee-9e1c-44e6-8f5b-ce4f67ef9e75 response_code = 204 uri = /eip-gateways
30772024-11-14T00:30:20.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43192 req_id = 7a678e26-1e7b-4c0f-8eef-7f5a99e18de5 response_code = 204 uri = /vpc-routes
30782024-11-14T00:30:21.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30792024-11-14T00:30:21.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30802024-11-14T00:30:21.196ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10
30812024-11-14T00:30:21.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e211d163-be78-4663-b73f-baf5e9462a10