Max level shown:
1 [ Dec 21 07:44:23 Enabled. ]
2 [ Dec 21 07:44:23 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 07:44:23 Method "start" exited with status 0. ]
4 [ Dec 21 07:44:23 Rereading configuration. ]
5 [ Dec 21 07:44:23 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T07:44:23.319ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T07:44:23.319ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T07:44:23.371ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T07:44:23.371ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T07:44:23.486ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T07:44:23.494ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T07:44:23.503ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T07:44:24.105ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-21T07:44:24.245ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T07:44:24.245ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T07:44:24.245ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T07:44:24.245ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-21T07:44:24.245ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-21T07:44:24.245ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-21T07:44:24.248ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T07:44:24.248ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T07:44:24.248ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T07:44:24.248ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T07:44:24.248ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T07:44:24.248ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T07:44:24.248ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T07:44:24.249ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T07:44:24.249ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T07:44:24.260ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T07:44:24.260ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool)
322024-12-21T07:44:24.384ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal }
332024-12-21T07:44:24.836ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T07:44:24.836ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T07:44:24.836ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T07:44:24.836ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T07:44:24.836ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-21T07:44:24.838ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-21T07:44:24.838ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-21T07:44:24.845ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-21T07:44:24.845ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool)
422024-12-21T07:44:24.954ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal }
432024-12-21T07:44:25.404ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-21T07:44:25.404ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-21T07:44:25.404ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482024-12-21T07:44:25.404ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-21T07:44:25.404ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-21T07:44:25.404ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-21T07:44:25.404ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-12-21T07:44:25.404ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-21T07:44:25.404ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-21T07:44:25.404ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
572024-12-21T07:44:25.404ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-12-21T07:44:25.404ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-21T07:44:25.404ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-21T07:44:25.404ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632024-12-21T07:44:25.404ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-12-21T07:44:25.404ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-21T07:44:25.404ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-21T07:44:25.404ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-21T07:44:25.404ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
702024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
712024-12-21T07:44:25.404ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
722024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-12-21T07:44:25.404ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-21T07:44:25.404ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-21T07:44:25.404ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-21T07:44:25.404ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-21T07:44:25.404ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-21T07:44:25.404ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-12-21T07:44:25.404ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-12-21T07:44:25.404ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842024-12-21T07:44:25.404ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-21T07:44:25.405ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-21T07:44:25.405ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872024-12-21T07:44:25.405ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-12-21T07:44:25.405ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-12-21T07:44:25.405ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-21T07:44:25.405ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-21T07:44:25.405ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-21T07:44:25.405ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932024-12-21T07:44:25.405ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-21T07:44:25.405ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-21T07:44:25.405ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-21T07:44:25.405ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-21T07:44:25.405ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-21T07:44:25.405ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-21T07:44:25.405ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-21T07:44:25.405ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-21T07:44:25.405ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-21T07:44:25.405ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032024-12-21T07:44:25.405ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-21T07:44:25.405ZINFOSledAgent (bootstore): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-21T07:44:25.405ZINFOSledAgent (bootstore): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-21T07:44:25.405ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-12-21T07:44:25.405ZINFOSledAgent (bootstore): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-21T07:44:25.405ZINFOSledAgent (bootstore): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-21T07:44:25.405ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-12-21T07:44:25.405ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-21T07:44:25.405ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-21T07:44:25.416ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-21T07:44:25.416ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1385, tv_nsec: 190598066 } time_to_next_cleanup = 599.999935769s
1142024-12-21T07:44:25.416ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1152024-12-21T07:44:25.419ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162024-12-21T07:44:25.419ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-21T07:44:25.419ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-21T07:44:25.420ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-12-21T07:44:25.421ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-12-21T07:44:25.422ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-21T07:44:25.422ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-21T07:44:25.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-21T07:44:25.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-21T07:44:25.422ZINFOSledAgent (RSS): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-21T07:44:25.422ZINFOSledAgent (RSS): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-21T07:44:25.422ZINFOSledAgent (RSS): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-21T07:44:25.422ZINFOSledAgent (RSS): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-21T07:44:25.422ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-21T07:44:25.422ZINFOSledAgent (RSS): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-21T07:44:25.422ZINFOSledAgent (RSS): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-21T07:44:25.423ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-21T07:44:25.423ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-21T07:44:25.423ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-21T07:44:25.423ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-21T07:44:25.423ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362024-12-21T07:44:25.423ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-12-21T07:44:25.423ZINFOSledAgent (bootstore): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382024-12-21T07:44:25.423ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392024-12-21T07:44:25.423ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e (sled), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402024-12-21T07:44:25.424ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1412024-12-21T07:44:25.424ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1422024-12-21T07:44:25.428ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-21T07:44:25.435ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-21T07:44:25.435ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-21T07:44:25.439ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-21T07:44:25.439ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-21T07:44:25.439ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:54663
1482024-12-21T07:44:25.439ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e (sled), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-21T07:44:25.439ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-21T07:44:25.439ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-21T07:44:25.439ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-21T07:44:25.439ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532024-12-21T07:44:25.439ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542024-12-21T07:44:25.439ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-21T07:44:25.439ZINFOSledAgent (StorageManager): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-21T07:44:25.439ZINFOSledAgent (StorageManager): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-21T07:44:25.439ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582024-12-21T07:44:25.439ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-21T07:44:25.439ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-21T07:44:25.439ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-21T07:44:25.439ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-21T07:44:25.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-21T07:44:25.476ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-21T07:44:25.494ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-21T07:44:25.519ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1662024-12-21T07:44:25.519ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-21T07:44:25.519ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1682024-12-21T07:44:25.519ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-21T07:44:25.522ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 117.018602ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "eab608da-4d97-4cfd-a78e-b683fd567840", "content-length": "124", "date": "Sat, 21 Dec 2024 07:44:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "eab608da-4d97-4cfd-a78e-b683fd567840" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-21T07:44:25.532ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-21T07:44:25.559ZINFOSledAgent: successfully created encrypted zvol: name="oxi_0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-21T07:44:25.559ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-21T07:44:25.565ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1742024-12-21T07:44:25.565ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-21T07:44:25.565ZINFOSledAgent (BackingFs): Ensuring dataset oxi_0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-21T07:44:25.640ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-21T07:44:25.640ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 155.445397ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "857fd918-785d-417e-88d0-548012afbcec", "content-length": "124", "date": "Sat, 21 Dec 2024 07:44:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "857fd918-785d-417e-88d0-548012afbcec" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-21T07:44:25.647ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792024-12-21T07:44:25.797ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-21T07:44:25.797ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 172.877025ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f85e845f-1f1e-4525-9e00-d8081ff8fbb0", "content-length": "124", "date": "Sat, 21 Dec 2024 07:44:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f85e845f-1f1e-4525-9e00-d8081ff8fbb0" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-21T07:44:25.867ZINFOSledAgent (BackingFs): Mounting oxi_0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822024-12-21T07:44:25.879ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832024-12-21T07:44:25.879ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842024-12-21T07:44:25.880ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852024-12-21T07:44:25.880ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862024-12-21T07:44:25.972ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-21T07:44:25.972ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 235.687394ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5f736d05-421b-463c-85d3-2d4061abf965", "content-length": "124", "date": "Sat, 21 Dec 2024 07:44:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5f736d05-421b-463c-85d3-2d4061abf965" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-21T07:44:26.209ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-21T07:44:26.210ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 163.210119ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4e04e9a0-9041-4c64-9011-1d97c65573a3", "content-length": "124", "date": "Sat, 21 Dec 2024 07:44:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4e04e9a0-9041-4c64-9011-1d97c65573a3" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-21T07:44:26.375ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-21T07:44:26.375ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 368.848567ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "36588d98-264a-4c8a-ab08-de59cc2336d5", "content-length": "124", "date": "Sat, 21 Dec 2024 07:44:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "36588d98-264a-4c8a-ab08-de59cc2336d5" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-21T07:44:26.639ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1932024-12-21T07:44:26.644ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:55605 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1942024-12-21T07:44:26.644ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1952024-12-21T07:44:26.644ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:55605 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1962024-12-21T07:44:26.645ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 327.326281ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1972024-12-21T07:44:26.646ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1982024-12-21T07:44:26.646ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
1992024-12-21T07:44:26.646ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2002024-12-21T07:44:26.646ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012024-12-21T07:44:26.745ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022024-12-21T07:44:26.978ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 334.235244ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2032024-12-21T07:44:27.313ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 500.887922ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2042024-12-21T07:44:27.816ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.284286509s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2052024-12-21T07:44:29.110ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2062024-12-21T07:44:29.110ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2072024-12-21T07:44:29.110ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2082024-12-21T07:44:29.110ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2092024-12-21T07:44:29.110ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2102024-12-21T07:44:29.110ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2112024-12-21T07:44:29.112ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2122024-12-21T07:44:29.114ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2132024-12-21T07:44:29.114ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='b2e6180f-2896-4592-b155-f5ca3f904fa7'/> <propval type="astring" name="rack_id" value='5b228607-94ff-4bfc-99d8-b10385e90443'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe5e:edf9'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='5b228607-94ff-4bfc-99d8-b10385e90443'/> <propval type="astring" name="sled_id" value='c992e3dc-2d80-4655-85d0-78e9a80bf69e'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='c992e3dc-2d80-4655-85d0-78e9a80bf69e'/> <propval type="astring" name="rack_uuid" value='5b228607-94ff-4bfc-99d8-b10385e90443'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='c992e3dc-2d80-4655-85d0-78e9a80bf69e'/> <propval type="astring" name="rack_uuid" value='5b228607-94ff-4bfc-99d8-b10385e90443'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-21T07:44:29.114ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-21T07:44:29.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 31.922027ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-21T07:44:29.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 87.09632ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-21T07:44:29.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 262.553744ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-21T07:44:30.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 413.666854ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-21T07:44:30.154ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.185313521s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2202024-12-21T07:44:30.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 595.387256ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-21T07:44:31.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 883.095326ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-21T07:44:32.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 745.062869ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-21T07:44:33.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.136535074s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-21T07:44:34.341ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.416551529s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2252024-12-21T07:44:34.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 544.75807ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-21T07:44:35.582ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/nexus.rs:527 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2272024-12-21T07:44:35.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282024-12-21T07:44:35.613ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2292024-12-21T07:44:35.614ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2302024-12-21T07:44:35.614ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312024-12-21T07:44:35.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322024-12-21T07:44:35.614ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-21T07:44:35.614ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-21T07:44:35.615ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352024-12-21T07:44:35.615ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362024-12-21T07:44:35.615ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2372024-12-21T07:44:35.615ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:54663
2382024-12-21T07:44:35.839ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2392024-12-21T07:44:35.839ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2402024-12-21T07:44:35.845ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412024-12-21T07:44:35.845ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2422024-12-21T07:44:35.845ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2432024-12-21T07:44:36.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46968
2442024-12-21T07:44:36.082ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452024-12-21T07:44:36.082ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462024-12-21T07:44:36.082ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-21T07:44:36.082ZINFOSledAgent (ServiceManager): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-21T07:44:36.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46968 req_id = 52715db4-ab73-420e-8015-ebebe56e210f response_code = 200 uri = /inventory
2492024-12-21T07:44:36.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42347
2502024-12-21T07:44:36.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42347 req_id = 59a7bc42-8b81-41e9-b412-1560a38044ec response_code = 200 uri = /sled-role
2512024-12-21T07:44:36.152ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 822d17a7-63e8-45ca-a20e-5fddfd18e56f (physical_disk), pool_id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: de8e7a94-ef1b-40f7-abcb-81ae19e3ff15 (physical_disk), pool_id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c26106c3-311d-4be6-a063-8b1e92d01c19 (physical_disk), pool_id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 02038cc0-2c82-4c54-82d3-56f767f1129a (physical_disk), pool_id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f161083b-7ab0-479e-b383-7e2767dae5b7 (physical_disk), pool_id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: cc9b408e-70f9-426c-a3fc-b3dd4b48cc2c (physical_disk), pool_id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e8771149-9ad1-4c6b-b8ad-33a06b23770e (physical_disk), pool_id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 08305eda-f7bf-47ee-a8de-b08b1584bf3c (physical_disk), pool_id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3d9a4ab4-b2b8-41bc-bec5-c550b6a9dcce (physical_disk), pool_id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2522024-12-21T07:44:36.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53724
2532024-12-21T07:44:36.152ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2542024-12-21T07:44:36.152ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 822d17a7-63e8-45ca-a20e-5fddfd18e56f (physical_disk), pool_id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: de8e7a94-ef1b-40f7-abcb-81ae19e3ff15 (physical_disk), pool_id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c26106c3-311d-4be6-a063-8b1e92d01c19 (physical_disk), pool_id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 02038cc0-2c82-4c54-82d3-56f767f1129a (physical_disk), pool_id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f161083b-7ab0-479e-b383-7e2767dae5b7 (physical_disk), pool_id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: cc9b408e-70f9-426c-a3fc-b3dd4b48cc2c (physical_disk), pool_id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e8771149-9ad1-4c6b-b8ad-33a06b23770e (physical_disk), pool_id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 08305eda-f7bf-47ee-a8de-b08b1584bf3c (physical_disk), pool_id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3d9a4ab4-b2b8-41bc-bec5-c550b6a9dcce (physical_disk), pool_id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2552024-12-21T07:44:36.152ZINFOSledAgent (StorageManager): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-21T07:44:36.152ZINFOSledAgent (StorageManager): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-21T07:44:36.152ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2582024-12-21T07:44:36.152ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592024-12-21T07:44:36.152ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602024-12-21T07:44:36.152ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612024-12-21T07:44:36.152ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622024-12-21T07:44:36.307ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2632024-12-21T07:44:36.307ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool)
2642024-12-21T07:44:36.752ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2652024-12-21T07:44:36.753ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2662024-12-21T07:44:36.754ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2672024-12-21T07:44:36.754ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
2682024-12-21T07:44:36.825ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }
2692024-12-21T07:44:36.834ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2702024-12-21T07:44:36.834ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2712024-12-21T07:44:36.834ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2722024-12-21T07:44:36.834ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2732024-12-21T07:44:36.834ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-21T07:44:36.834ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-21T07:44:36.834ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2762024-12-21T07:44:36.871ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772024-12-21T07:44:36.879ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone file = sled-storage/src/dataset.rs:302
2782024-12-21T07:44:37.046ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff file = sled-storage/src/dataset.rs:388
2792024-12-21T07:44:37.054ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802024-12-21T07:44:37.054ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812024-12-21T07:44:37.054ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822024-12-21T07:44:37.054ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832024-12-21T07:44:37.054ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842024-12-21T07:44:37.064ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852024-12-21T07:44:37.064ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool)
2862024-12-21T07:44:37.176ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }
2872024-12-21T07:44:37.184ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882024-12-21T07:44:37.184ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892024-12-21T07:44:37.184ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902024-12-21T07:44:37.184ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912024-12-21T07:44:37.184ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-21T07:44:37.185ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-21T07:44:37.185ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942024-12-21T07:44:37.220ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-12-21T07:44:37.229ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone file = sled-storage/src/dataset.rs:302
2962024-12-21T07:44:37.402ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac file = sled-storage/src/dataset.rs:388
2972024-12-21T07:44:37.410ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982024-12-21T07:44:37.410ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992024-12-21T07:44:37.410ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002024-12-21T07:44:37.410ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012024-12-21T07:44:37.410ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022024-12-21T07:44:37.421ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032024-12-21T07:44:37.421ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool)
3042024-12-21T07:44:37.526ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }
3052024-12-21T07:44:37.534ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062024-12-21T07:44:37.534ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072024-12-21T07:44:37.534ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082024-12-21T07:44:37.534ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092024-12-21T07:44:37.534ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-21T07:44:37.534ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-21T07:44:37.534ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122024-12-21T07:44:37.573ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132024-12-21T07:44:37.580ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone file = sled-storage/src/dataset.rs:302
3142024-12-21T07:44:37.743ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240 file = sled-storage/src/dataset.rs:388
3152024-12-21T07:44:37.751ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162024-12-21T07:44:37.751ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172024-12-21T07:44:37.751ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182024-12-21T07:44:37.751ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192024-12-21T07:44:37.751ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202024-12-21T07:44:37.761ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212024-12-21T07:44:37.761ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool)
3222024-12-21T07:44:37.876ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }
3232024-12-21T07:44:37.884ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242024-12-21T07:44:37.884ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252024-12-21T07:44:37.884ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262024-12-21T07:44:37.884ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272024-12-21T07:44:37.884ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-21T07:44:37.884ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-21T07:44:37.884ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302024-12-21T07:44:37.887ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
3312024-12-21T07:44:37.926ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-12-21T07:44:37.934ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone file = sled-storage/src/dataset.rs:302
3332024-12-21T07:44:38.107ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9cd7c5ec-686c-4ecd-8837-505154304410 file = sled-storage/src/dataset.rs:388
3342024-12-21T07:44:38.116ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352024-12-21T07:44:38.116ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362024-12-21T07:44:38.116ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372024-12-21T07:44:38.116ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-12-21T07:44:38.116ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-12-21T07:44:38.127ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402024-12-21T07:44:38.127ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool)
3412024-12-21T07:44:38.235ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }
3422024-12-21T07:44:38.243ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3432024-12-21T07:44:38.243ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3442024-12-21T07:44:38.243ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3452024-12-21T07:44:38.243ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3462024-12-21T07:44:38.243ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-21T07:44:38.243ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-21T07:44:38.243ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3492024-12-21T07:44:38.284ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-12-21T07:44:38.291ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone file = sled-storage/src/dataset.rs:302
3512024-12-21T07:44:38.463ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7 file = sled-storage/src/dataset.rs:388
3522024-12-21T07:44:38.471ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532024-12-21T07:44:38.471ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542024-12-21T07:44:38.471ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552024-12-21T07:44:38.471ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-12-21T07:44:38.471ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-12-21T07:44:38.480ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582024-12-21T07:44:38.480ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool)
3592024-12-21T07:44:38.590ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }
3602024-12-21T07:44:38.598ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612024-12-21T07:44:38.598ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622024-12-21T07:44:38.598ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632024-12-21T07:44:38.598ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642024-12-21T07:44:38.598ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-21T07:44:38.598ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-21T07:44:38.598ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672024-12-21T07:44:38.639ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-12-21T07:44:38.645ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crypt/zone file = sled-storage/src/dataset.rs:302
3692024-12-21T07:44:38.804ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e file = sled-storage/src/dataset.rs:388
3702024-12-21T07:44:38.811ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712024-12-21T07:44:38.811ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722024-12-21T07:44:38.811ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732024-12-21T07:44:38.811ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742024-12-21T07:44:38.811ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752024-12-21T07:44:38.820ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762024-12-21T07:44:38.820ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d75297c3-49da-487f-a95f-88dc2681ce54 (zpool)
3772024-12-21T07:44:38.930ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }
3782024-12-21T07:44:38.939ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792024-12-21T07:44:38.939ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802024-12-21T07:44:38.939ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812024-12-21T07:44:38.939ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822024-12-21T07:44:38.939ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-21T07:44:38.939ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-21T07:44:38.939ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852024-12-21T07:44:38.942ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
3862024-12-21T07:44:38.983ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-12-21T07:44:38.990ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d75297c3-49da-487f-a95f-88dc2681ce54/crypt/zone file = sled-storage/src/dataset.rs:302
3882024-12-21T07:44:39.159ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d75297c3-49da-487f-a95f-88dc2681ce54 file = sled-storage/src/dataset.rs:388
3892024-12-21T07:44:39.167ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902024-12-21T07:44:39.167ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912024-12-21T07:44:39.167ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922024-12-21T07:44:39.167ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-12-21T07:44:39.167ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942024-12-21T07:44:39.177ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952024-12-21T07:44:39.177ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool)
3962024-12-21T07:44:39.311ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }
3972024-12-21T07:44:39.319ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982024-12-21T07:44:39.319ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992024-12-21T07:44:39.319ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002024-12-21T07:44:39.319ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012024-12-21T07:44:39.319ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-21T07:44:39.320ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-21T07:44:39.320ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042024-12-21T07:44:39.363ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-21T07:44:39.371ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798/crypt/zone file = sled-storage/src/dataset.rs:302
4062024-12-21T07:44:39.542ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798 file = sled-storage/src/dataset.rs:388
4072024-12-21T07:44:39.550ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082024-12-21T07:44:39.550ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092024-12-21T07:44:39.550ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102024-12-21T07:44:39.550ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-12-21T07:44:39.550ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122024-12-21T07:44:39.560ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132024-12-21T07:44:39.560ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool)
4142024-12-21T07:44:39.675ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }
4152024-12-21T07:44:39.683ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162024-12-21T07:44:39.683ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172024-12-21T07:44:39.683ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182024-12-21T07:44:39.683ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192024-12-21T07:44:39.683ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-21T07:44:39.683ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-21T07:44:39.683ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222024-12-21T07:44:39.727ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-21T07:44:39.735ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone file = sled-storage/src/dataset.rs:302
4242024-12-21T07:44:39.907ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64 file = sled-storage/src/dataset.rs:388
4252024-12-21T07:44:39.915ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262024-12-21T07:44:39.915ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272024-12-21T07:44:39.915ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-12-21T07:44:39.915ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52553f89-077b-4090-bd7d-0f6aaa2f3eae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292024-12-21T07:44:39.916ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302024-12-21T07:44:39.916ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312024-12-21T07:44:39.916ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-12-21T07:44:39.916ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4332024-12-21T07:44:39.916ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342024-12-21T07:44:39.916ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4352024-12-21T07:44:39.916ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4362024-12-21T07:44:39.916ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4372024-12-21T07:44:39.916ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4382024-12-21T07:44:39.916ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4392024-12-21T07:44:39.916ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402024-12-21T07:44:39.916ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4412024-12-21T07:44:39.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3763978 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53724 req_id = 79870968-6b94-43bb-8c58-0a72ba0b9e64 response_code = 200 uri = /omicron-physical-disks
4422024-12-21T07:44:39.945ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4432024-12-21T07:44:39.948ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0131f977-1b95-47b7-917a-a361324d75e5 (dataset): DatasetConfig { id: 0131f977-1b95-47b7-917a-a361324d75e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09698e90-fb33-46c9-b479-22715973d1df (dataset): DatasetConfig { id: 09698e90-fb33-46c9-b479-22715973d1df (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a46a168-ad52-4fb8-8094-a7d033f172b8 (dataset): DatasetConfig { id: 0a46a168-ad52-4fb8-8094-a7d033f172b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c1b84cb-895b-4282-b52f-4d231ca77fcd (dataset): DatasetConfig { id: 0c1b84cb-895b-4282-b52f-4d231ca77fcd (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c50e698-96be-4893-a543-a382dcd0c490 (dataset): DatasetConfig { id: 0c50e698-96be-4893-a543-a382dcd0c490 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0cb27f66-e700-4b7f-84eb-561ca8e71a5b (dataset): DatasetConfig { id: 0cb27f66-e700-4b7f-84eb-561ca8e71a5b (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1be810b1-8627-4ddc-8162-7b70354e745c (dataset): DatasetConfig { id: 1be810b1-8627-4ddc-8162-7b70354e745c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22a54457-9404-4e9b-a4ca-069971fafc3a (dataset): DatasetConfig { id: 22a54457-9404-4e9b-a4ca-069971fafc3a (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23d3eb14-d20f-43ef-8373-e2cc752bfbb9 (dataset): DatasetConfig { id: 23d3eb14-d20f-43ef-8373-e2cc752bfbb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 287998b4-e322-43e9-9cf5-476362967a2a (dataset): DatasetConfig { id: 287998b4-e322-43e9-9cf5-476362967a2a (dataset), name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d40678c-461d-4b0e-b178-c59a8b2ab1d5 (dataset): DatasetConfig { id: 2d40678c-461d-4b0e-b178-c59a8b2ab1d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 396eb514-d422-4750-964d-55eaf5c583b7 (dataset): DatasetConfig { id: 396eb514-d422-4750-964d-55eaf5c583b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b594d0c-3a3b-40d7-9b75-7565a0fbf8df (dataset): DatasetConfig { id: 3b594d0c-3a3b-40d7-9b75-7565a0fbf8df (dataset), name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e8087f3-01b4-4241-9244-8ccd57190056 (dataset): DatasetConfig { id: 3e8087f3-01b4-4241-9244-8ccd57190056 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 403b9b3c-2394-453d-9f55-2a49d5fffcf6 (dataset): DatasetConfig { id: 403b9b3c-2394-453d-9f55-2a49d5fffcf6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4211cc5e-5cfc-4558-9c21-e5db29a952d4 (dataset): DatasetConfig { id: 4211cc5e-5cfc-4558-9c21-e5db29a952d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2858b358-7183-451f-b471-559976754305" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46f0e1d6-8c0c-4f5b-a04c-536a8d43985e (dataset): DatasetConfig { id: 46f0e1d6-8c0c-4f5b-a04c-536a8d43985e (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 483a227d-c7c2-42f2-a477-f6ce9dbf5248 (dataset): DatasetConfig { id: 483a227d-c7c2-42f2-a477-f6ce9dbf5248 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 496324f4-e078-4046-adae-08790f969f6d (dataset): DatasetConfig { id: 496324f4-e078-4046-adae-08790f969f6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a3c6710-fa20-4dac-9b00-d736835b22ab (dataset): DatasetConfig { id: 4a3c6710-fa20-4dac-9b00-d736835b22ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ea845ae-85dd-4580-80cd-946388788325 (dataset): DatasetConfig { id: 4ea845ae-85dd-4580-80cd-946388788325 (dataset), name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5080da13-fa94-4b89-9bed-be9e9c8b1093 (dataset): DatasetConfig { id: 5080da13-fa94-4b89-9bed-be9e9c8b1093 (dataset), name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53d0bf56-cc74-45af-9331-ea8961333512 (dataset): DatasetConfig { id: 53d0bf56-cc74-45af-9331-ea8961333512 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57761fdf-6c01-419d-9d76-e1e241572199 (dataset): DatasetConfig { id: 57761fdf-6c01-419d-9d76-e1e241572199 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d60c210-287d-4c42-90c4-a08636f90d1c (dataset): DatasetConfig { id: 5d60c210-287d-4c42-90c4-a08636f90d1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6096f1a1-467c-492a-827b-77552ff837dd (dataset): DatasetConfig { id: 6096f1a1-467c-492a-827b-77552ff837dd (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63b13722-5848-4a70-b2f9-95126ead02af (dataset): DatasetConfig { id: 63b13722-5848-4a70-b2f9-95126ead02af (dataset), name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 63cd200b-a36c-47ae-970c-07b818b3898f (dataset): DatasetConfig { id: 63cd200b-a36c-47ae-970c-07b818b3898f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64bf47ad-5914-402b-a5b4-9935d3cb94db (dataset): DatasetConfig { id: 64bf47ad-5914-402b-a5b4-9935d3cb94db (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a372efc-fb02-4eac-b288-4522829aff3d (dataset): DatasetConfig { id: 6a372efc-fb02-4eac-b288-4522829aff3d (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6efe09ff-8f8a-44d3-a693-fd374329440c (dataset): DatasetConfig { id: 6efe09ff-8f8a-44d3-a693-fd374329440c (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 736d079b-8f28-4487-92fb-d85ed3784707 (dataset): DatasetConfig { id: 736d079b-8f28-4487-92fb-d85ed3784707 (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74968b04-90b0-4489-9b7d-17fbbd662065 (dataset): DatasetConfig { id: 74968b04-90b0-4489-9b7d-17fbbd662065 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7a02c0c0-e938-479b-b60a-6d08f2cee86e (dataset): DatasetConfig { id: 7a02c0c0-e938-479b-b60a-6d08f2cee86e (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ec69268-a563-4afb-8696-e7070f61f8a3 (dataset): DatasetConfig { id: 7ec69268-a563-4afb-8696-e7070f61f8a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84e02fa1-1386-499f-b0dc-acfb0a62fc96 (dataset): DatasetConfig { id: 84e02fa1-1386-499f-b0dc-acfb0a62fc96 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 89a94acd-acfa-45b7-a404-fea53b46f736 (dataset): DatasetConfig { id: 89a94acd-acfa-45b7-a404-fea53b46f736 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e739539-a0d1-420c-8439-97ccb4b01b52 (dataset): DatasetConfig { id: 8e739539-a0d1-420c-8439-97ccb4b01b52 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f1411ce-94c3-405c-a5de-bd1c74c1777c (dataset): DatasetConfig { id: 8f1411ce-94c3-405c-a5de-bd1c74c1777c (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8fb0968e-4681-4ca8-83ff-2ee71ca9e929 (dataset): DatasetConfig { id: 8fb0968e-4681-4ca8-83ff-2ee71ca9e929 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91242e1d-b606-43d9-ad24-34902e90b5c9 (dataset): DatasetConfig { id: 91242e1d-b606-43d9-ad24-34902e90b5c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 916163ea-83fb-45ab-b648-cee250f8a7d8 (dataset): DatasetConfig { id: 916163ea-83fb-45ab-b648-cee250f8a7d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94fe85a4-83ef-43b7-8a5a-aa61cc59eabd (dataset): DatasetConfig { id: 94fe85a4-83ef-43b7-8a5a-aa61cc59eabd (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6505a1b-4510-45b1-8f9c-fb3aa4eddc7f (dataset): DatasetConfig { id: a6505a1b-4510-45b1-8f9c-fb3aa4eddc7f (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a761aa6a-99c4-4cef-a7e6-8031912bb420 (dataset): DatasetConfig { id: a761aa6a-99c4-4cef-a7e6-8031912bb420 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a894b935-ae9a-4bd4-a931-b9c5fb6dad26 (dataset): DatasetConfig { id: a894b935-ae9a-4bd4-a931-b9c5fb6dad26 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, acd97831-d126-4dde-9874-976b4a5f19c3 (dataset): DatasetConfig { id: acd97831-d126-4dde-9874-976b4a5f19c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b06f2470-6e41-4780-845a-265d3b9a1eb9 (dataset): DatasetConfig { id: b06f2470-6e41-4780-845a-265d3b9a1eb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0ad3802-9eb0-4640-b8f7-8ebd180a09d4 (dataset): DatasetConfig { id: b0ad3802-9eb0-4640-b8f7-8ebd180a09d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baaa9c0a-c387-4cf0-ae01-1df2308dacf8 (dataset): DatasetConfig { id: baaa9c0a-c387-4cf0-ae01-1df2308dacf8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c50bd2b0-71ab-4f6c-87f0-3055b762f963 (dataset): DatasetConfig { id: c50bd2b0-71ab-4f6c-87f0-3055b762f963 (dataset), name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, caeff371-89c1-4717-be15-276d2fbb5ff5 (dataset): DatasetConfig { id: caeff371-89c1-4717-be15-276d2fbb5ff5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cdbc0551-0f8a-45c8-850f-432b5b276284 (dataset): DatasetConfig { id: cdbc0551-0f8a-45c8-850f-432b5b276284 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d23e2353-d7db-4883-bb03-1dde8cd417d0 (dataset): DatasetConfig { id: d23e2353-d7db-4883-bb03-1dde8cd417d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d39eeead-58d5-40d4-956e-fd5aa4301734 (dataset): DatasetConfig { id: d39eeead-58d5-40d4-956e-fd5aa4301734 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d52701e7-3634-41cc-87df-393ce800b121 (dataset): DatasetConfig { id: d52701e7-3634-41cc-87df-393ce800b121 (dataset), name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9144f0a-b850-49ae-8139-b2c6ccc3978a (dataset): DatasetConfig { id: d9144f0a-b850-49ae-8139-b2c6ccc3978a (dataset), name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daa435b3-c684-4558-95d4-b6ee7a2b6178 (dataset): DatasetConfig { id: daa435b3-c684-4558-95d4-b6ee7a2b6178 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dded44a6-0370-47f7-b900-0c2bb94d52ce (dataset): DatasetConfig { id: dded44a6-0370-47f7-b900-0c2bb94d52ce (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddf464d6-595a-4ec8-930d-13287f872fbf (dataset): DatasetConfig { id: ddf464d6-595a-4ec8-930d-13287f872fbf (dataset), name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e0a5a24f-8740-42de-b045-c54e56c72f40 (dataset): DatasetConfig { id: e0a5a24f-8740-42de-b045-c54e56c72f40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efb9344a-a071-4313-91c9-2c18e4ce8e1d (dataset): DatasetConfig { id: efb9344a-a071-4313-91c9-2c18e4ce8e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1fec295-4f2c-4ac8-8dda-5620325d35e9 (dataset): DatasetConfig { id: f1fec295-4f2c-4ac8-8dda-5620325d35e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3112ad1-b362-4a34-86e7-b4b7965c3e8f (dataset): DatasetConfig { id: f3112ad1-b362-4a34-86e7-b4b7965c3e8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcca6bd8-a073-4f5c-82a4-0612c8506f63 (dataset): DatasetConfig { id: fcca6bd8-a073-4f5c-82a4-0612c8506f63 (dataset), name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcefe159-a27f-4a3d-b15b-687a4c16f26b (dataset): DatasetConfig { id: fcefe159-a27f-4a3d-b15b-687a4c16f26b (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4442024-12-21T07:44:39.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45574
4452024-12-21T07:44:39.948ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4462024-12-21T07:44:39.949ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0131f977-1b95-47b7-917a-a361324d75e5 (dataset): DatasetConfig { id: 0131f977-1b95-47b7-917a-a361324d75e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09698e90-fb33-46c9-b479-22715973d1df (dataset): DatasetConfig { id: 09698e90-fb33-46c9-b479-22715973d1df (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a46a168-ad52-4fb8-8094-a7d033f172b8 (dataset): DatasetConfig { id: 0a46a168-ad52-4fb8-8094-a7d033f172b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c1b84cb-895b-4282-b52f-4d231ca77fcd (dataset): DatasetConfig { id: 0c1b84cb-895b-4282-b52f-4d231ca77fcd (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c50e698-96be-4893-a543-a382dcd0c490 (dataset): DatasetConfig { id: 0c50e698-96be-4893-a543-a382dcd0c490 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0cb27f66-e700-4b7f-84eb-561ca8e71a5b (dataset): DatasetConfig { id: 0cb27f66-e700-4b7f-84eb-561ca8e71a5b (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1be810b1-8627-4ddc-8162-7b70354e745c (dataset): DatasetConfig { id: 1be810b1-8627-4ddc-8162-7b70354e745c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22a54457-9404-4e9b-a4ca-069971fafc3a (dataset): DatasetConfig { id: 22a54457-9404-4e9b-a4ca-069971fafc3a (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23d3eb14-d20f-43ef-8373-e2cc752bfbb9 (dataset): DatasetConfig { id: 23d3eb14-d20f-43ef-8373-e2cc752bfbb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 287998b4-e322-43e9-9cf5-476362967a2a (dataset): DatasetConfig { id: 287998b4-e322-43e9-9cf5-476362967a2a (dataset), name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d40678c-461d-4b0e-b178-c59a8b2ab1d5 (dataset): DatasetConfig { id: 2d40678c-461d-4b0e-b178-c59a8b2ab1d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 396eb514-d422-4750-964d-55eaf5c583b7 (dataset): DatasetConfig { id: 396eb514-d422-4750-964d-55eaf5c583b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b594d0c-3a3b-40d7-9b75-7565a0fbf8df (dataset): DatasetConfig { id: 3b594d0c-3a3b-40d7-9b75-7565a0fbf8df (dataset), name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e8087f3-01b4-4241-9244-8ccd57190056 (dataset): DatasetConfig { id: 3e8087f3-01b4-4241-9244-8ccd57190056 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 403b9b3c-2394-453d-9f55-2a49d5fffcf6 (dataset): DatasetConfig { id: 403b9b3c-2394-453d-9f55-2a49d5fffcf6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4211cc5e-5cfc-4558-9c21-e5db29a952d4 (dataset): DatasetConfig { id: 4211cc5e-5cfc-4558-9c21-e5db29a952d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2858b358-7183-451f-b471-559976754305" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46f0e1d6-8c0c-4f5b-a04c-536a8d43985e (dataset): DatasetConfig { id: 46f0e1d6-8c0c-4f5b-a04c-536a8d43985e (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 483a227d-c7c2-42f2-a477-f6ce9dbf5248 (dataset): DatasetConfig { id: 483a227d-c7c2-42f2-a477-f6ce9dbf5248 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 496324f4-e078-4046-adae-08790f969f6d (dataset): DatasetConfig { id: 496324f4-e078-4046-adae-08790f969f6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a3c6710-fa20-4dac-9b00-d736835b22ab (dataset): DatasetConfig { id: 4a3c6710-fa20-4dac-9b00-d736835b22ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ea845ae-85dd-4580-80cd-946388788325 (dataset): DatasetConfig { id: 4ea845ae-85dd-4580-80cd-946388788325 (dataset), name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5080da13-fa94-4b89-9bed-be9e9c8b1093 (dataset): DatasetConfig { id: 5080da13-fa94-4b89-9bed-be9e9c8b1093 (dataset), name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53d0bf56-cc74-45af-9331-ea8961333512 (dataset): DatasetConfig { id: 53d0bf56-cc74-45af-9331-ea8961333512 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57761fdf-6c01-419d-9d76-e1e241572199 (dataset): DatasetConfig { id: 57761fdf-6c01-419d-9d76-e1e241572199 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d60c210-287d-4c42-90c4-a08636f90d1c (dataset): DatasetConfig { id: 5d60c210-287d-4c42-90c4-a08636f90d1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6096f1a1-467c-492a-827b-77552ff837dd (dataset): DatasetConfig { id: 6096f1a1-467c-492a-827b-77552ff837dd (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63b13722-5848-4a70-b2f9-95126ead02af (dataset): DatasetConfig { id: 63b13722-5848-4a70-b2f9-95126ead02af (dataset), name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 63cd200b-a36c-47ae-970c-07b818b3898f (dataset): DatasetConfig { id: 63cd200b-a36c-47ae-970c-07b818b3898f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64bf47ad-5914-402b-a5b4-9935d3cb94db (dataset): DatasetConfig { id: 64bf47ad-5914-402b-a5b4-9935d3cb94db (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a372efc-fb02-4eac-b288-4522829aff3d (dataset): DatasetConfig { id: 6a372efc-fb02-4eac-b288-4522829aff3d (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6efe09ff-8f8a-44d3-a693-fd374329440c (dataset): DatasetConfig { id: 6efe09ff-8f8a-44d3-a693-fd374329440c (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 736d079b-8f28-4487-92fb-d85ed3784707 (dataset): DatasetConfig { id: 736d079b-8f28-4487-92fb-d85ed3784707 (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74968b04-90b0-4489-9b7d-17fbbd662065 (dataset): DatasetConfig { id: 74968b04-90b0-4489-9b7d-17fbbd662065 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7a02c0c0-e938-479b-b60a-6d08f2cee86e (dataset): DatasetConfig { id: 7a02c0c0-e938-479b-b60a-6d08f2cee86e (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ec69268-a563-4afb-8696-e7070f61f8a3 (dataset): DatasetConfig { id: 7ec69268-a563-4afb-8696-e7070f61f8a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84e02fa1-1386-499f-b0dc-acfb0a62fc96 (dataset): DatasetConfig { id: 84e02fa1-1386-499f-b0dc-acfb0a62fc96 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 89a94acd-acfa-45b7-a404-fea53b46f736 (dataset): DatasetConfig { id: 89a94acd-acfa-45b7-a404-fea53b46f736 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e739539-a0d1-420c-8439-97ccb4b01b52 (dataset): DatasetConfig { id: 8e739539-a0d1-420c-8439-97ccb4b01b52 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f1411ce-94c3-405c-a5de-bd1c74c1777c (dataset): DatasetConfig { id: 8f1411ce-94c3-405c-a5de-bd1c74c1777c (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8fb0968e-4681-4ca8-83ff-2ee71ca9e929 (dataset): DatasetConfig { id: 8fb0968e-4681-4ca8-83ff-2ee71ca9e929 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91242e1d-b606-43d9-ad24-34902e90b5c9 (dataset): DatasetConfig { id: 91242e1d-b606-43d9-ad24-34902e90b5c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 916163ea-83fb-45ab-b648-cee250f8a7d8 (dataset): DatasetConfig { id: 916163ea-83fb-45ab-b648-cee250f8a7d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94fe85a4-83ef-43b7-8a5a-aa61cc59eabd (dataset): DatasetConfig { id: 94fe85a4-83ef-43b7-8a5a-aa61cc59eabd (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6505a1b-4510-45b1-8f9c-fb3aa4eddc7f (dataset): DatasetConfig { id: a6505a1b-4510-45b1-8f9c-fb3aa4eddc7f (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a761aa6a-99c4-4cef-a7e6-8031912bb420 (dataset): DatasetConfig { id: a761aa6a-99c4-4cef-a7e6-8031912bb420 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a894b935-ae9a-4bd4-a931-b9c5fb6dad26 (dataset): DatasetConfig { id: a894b935-ae9a-4bd4-a931-b9c5fb6dad26 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, acd97831-d126-4dde-9874-976b4a5f19c3 (dataset): DatasetConfig { id: acd97831-d126-4dde-9874-976b4a5f19c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b06f2470-6e41-4780-845a-265d3b9a1eb9 (dataset): DatasetConfig { id: b06f2470-6e41-4780-845a-265d3b9a1eb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0ad3802-9eb0-4640-b8f7-8ebd180a09d4 (dataset): DatasetConfig { id: b0ad3802-9eb0-4640-b8f7-8ebd180a09d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baaa9c0a-c387-4cf0-ae01-1df2308dacf8 (dataset): DatasetConfig { id: baaa9c0a-c387-4cf0-ae01-1df2308dacf8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c50bd2b0-71ab-4f6c-87f0-3055b762f963 (dataset): DatasetConfig { id: c50bd2b0-71ab-4f6c-87f0-3055b762f963 (dataset), name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, caeff371-89c1-4717-be15-276d2fbb5ff5 (dataset): DatasetConfig { id: caeff371-89c1-4717-be15-276d2fbb5ff5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cdbc0551-0f8a-45c8-850f-432b5b276284 (dataset): DatasetConfig { id: cdbc0551-0f8a-45c8-850f-432b5b276284 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d23e2353-d7db-4883-bb03-1dde8cd417d0 (dataset): DatasetConfig { id: d23e2353-d7db-4883-bb03-1dde8cd417d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d39eeead-58d5-40d4-956e-fd5aa4301734 (dataset): DatasetConfig { id: d39eeead-58d5-40d4-956e-fd5aa4301734 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d52701e7-3634-41cc-87df-393ce800b121 (dataset): DatasetConfig { id: d52701e7-3634-41cc-87df-393ce800b121 (dataset), name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9144f0a-b850-49ae-8139-b2c6ccc3978a (dataset): DatasetConfig { id: d9144f0a-b850-49ae-8139-b2c6ccc3978a (dataset), name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daa435b3-c684-4558-95d4-b6ee7a2b6178 (dataset): DatasetConfig { id: daa435b3-c684-4558-95d4-b6ee7a2b6178 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dded44a6-0370-47f7-b900-0c2bb94d52ce (dataset): DatasetConfig { id: dded44a6-0370-47f7-b900-0c2bb94d52ce (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddf464d6-595a-4ec8-930d-13287f872fbf (dataset): DatasetConfig { id: ddf464d6-595a-4ec8-930d-13287f872fbf (dataset), name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e0a5a24f-8740-42de-b045-c54e56c72f40 (dataset): DatasetConfig { id: e0a5a24f-8740-42de-b045-c54e56c72f40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efb9344a-a071-4313-91c9-2c18e4ce8e1d (dataset): DatasetConfig { id: efb9344a-a071-4313-91c9-2c18e4ce8e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1fec295-4f2c-4ac8-8dda-5620325d35e9 (dataset): DatasetConfig { id: f1fec295-4f2c-4ac8-8dda-5620325d35e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3112ad1-b362-4a34-86e7-b4b7965c3e8f (dataset): DatasetConfig { id: f3112ad1-b362-4a34-86e7-b4b7965c3e8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcca6bd8-a073-4f5c-82a4-0612c8506f63 (dataset): DatasetConfig { id: fcca6bd8-a073-4f5c-82a4-0612c8506f63 (dataset), name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcefe159-a27f-4a3d-b15b-687a4c16f26b (dataset): DatasetConfig { id: fcefe159-a27f-4a3d-b15b-687a4c16f26b (dataset), name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4472024-12-21T07:44:39.949ZINFOSledAgent (StorageManager): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-21T07:44:39.949ZINFOSledAgent (StorageManager): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492024-12-21T07:44:39.949ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4502024-12-21T07:44:39.964ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4512024-12-21T07:44:39.964ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4522024-12-21T07:44:39.964ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone/oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd"), full_name: "oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone/oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd" } file = sled-storage/src/manager.rs:1431
4532024-12-21T07:44:40.038ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542024-12-21T07:44:40.038ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552024-12-21T07:44:40.038ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4562024-12-21T07:44:40.104ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572024-12-21T07:44:40.104ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582024-12-21T07:44:40.104ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571" } file = sled-storage/src/manager.rs:1431
4592024-12-21T07:44:40.178ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602024-12-21T07:44:40.178ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612024-12-21T07:44:40.178ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crucible" } file = sled-storage/src/manager.rs:1431
4622024-12-21T07:44:40.243ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632024-12-21T07:44:40.243ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4642024-12-21T07:44:40.243ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/debug"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/debug" } file = sled-storage/src/manager.rs:1431
4652024-12-21T07:44:40.283ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662024-12-21T07:44:40.283ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672024-12-21T07:44:40.283ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468" } file = sled-storage/src/manager.rs:1431
4682024-12-21T07:44:40.356ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692024-12-21T07:44:40.356ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702024-12-21T07:44:40.356ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64/crucible" } file = sled-storage/src/manager.rs:1431
4712024-12-21T07:44:40.423ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722024-12-21T07:44:40.423ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732024-12-21T07:44:40.423ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4742024-12-21T07:44:40.487ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752024-12-21T07:44:40.487ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4762024-12-21T07:44:40.488ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone"), full_name: "oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone" } file = sled-storage/src/manager.rs:1431
4772024-12-21T07:44:40.525ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782024-12-21T07:44:40.525ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4792024-12-21T07:44:40.525ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crucible" } file = sled-storage/src/manager.rs:1431
4802024-12-21T07:44:40.588ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812024-12-21T07:44:40.588ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822024-12-21T07:44:40.588ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crucible" } file = sled-storage/src/manager.rs:1431
4832024-12-21T07:44:40.650ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842024-12-21T07:44:40.650ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852024-12-21T07:44:40.650ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4862024-12-21T07:44:40.716ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872024-12-21T07:44:40.716ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4882024-12-21T07:44:40.717ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/250ef3db-29d3-4600-be58-ffbaa8dc3798/crypt/zone"), full_name: "oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798/crypt/zone" } file = sled-storage/src/manager.rs:1431
4892024-12-21T07:44:40.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902024-12-21T07:44:40.757ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912024-12-21T07:44:40.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone/oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434"), full_name: "oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone/oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434" } file = sled-storage/src/manager.rs:1431
4922024-12-21T07:44:40.831ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932024-12-21T07:44:40.831ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942024-12-21T07:44:40.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798/crucible" } file = sled-storage/src/manager.rs:1431
4952024-12-21T07:44:40.892ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962024-12-21T07:44:40.892ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972024-12-21T07:44:40.892ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone/oxz_crucible_2858b358-7183-451f-b471-559976754305"), full_name: "oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone/oxz_crucible_2858b358-7183-451f-b471-559976754305" } file = sled-storage/src/manager.rs:1431
4982024-12-21T07:44:40.947ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
4992024-12-21T07:44:40.971ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002024-12-21T07:44:40.971ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012024-12-21T07:44:40.971ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone/oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone/oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35" } file = sled-storage/src/manager.rs:1431
5022024-12-21T07:44:41.044ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032024-12-21T07:44:41.044ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5042024-12-21T07:44:41.044ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/debug"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/debug" } file = sled-storage/src/manager.rs:1431
5052024-12-21T07:44:41.086ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062024-12-21T07:44:41.086ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5072024-12-21T07:44:41.086ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5082024-12-21T07:44:41.151ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092024-12-21T07:44:41.151ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5102024-12-21T07:44:41.151ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone/oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e"), full_name: "oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone/oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e" } file = sled-storage/src/manager.rs:1431
5112024-12-21T07:44:41.227ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122024-12-21T07:44:41.227ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5132024-12-21T07:44:41.227ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crypt/zone"), full_name: "oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crypt/zone" } file = sled-storage/src/manager.rs:1431
5142024-12-21T07:44:41.266ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152024-12-21T07:44:41.266ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5162024-12-21T07:44:41.266ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d75297c3-49da-487f-a95f-88dc2681ce54/crypt/zone"), full_name: "oxp_d75297c3-49da-487f-a95f-88dc2681ce54/crypt/zone" } file = sled-storage/src/manager.rs:1431
5172024-12-21T07:44:41.307ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182024-12-21T07:44:41.307ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5192024-12-21T07:44:41.307ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6" } file = sled-storage/src/manager.rs:1431
5202024-12-21T07:44:41.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212024-12-21T07:44:41.383ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5222024-12-21T07:44:41.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone"), full_name: "oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone" } file = sled-storage/src/manager.rs:1431
5232024-12-21T07:44:41.424ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242024-12-21T07:44:41.424ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252024-12-21T07:44:41.424ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone/oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone/oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3" } file = sled-storage/src/manager.rs:1431
5262024-12-21T07:44:41.499ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272024-12-21T07:44:41.499ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282024-12-21T07:44:41.499ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5292024-12-21T07:44:41.565ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302024-12-21T07:44:41.565ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5312024-12-21T07:44:41.565ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d75297c3-49da-487f-a95f-88dc2681ce54/crypt/debug"), full_name: "oxp_d75297c3-49da-487f-a95f-88dc2681ce54/crypt/debug" } file = sled-storage/src/manager.rs:1431
5322024-12-21T07:44:41.605ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332024-12-21T07:44:41.605ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342024-12-21T07:44:41.605ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone/oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a"), full_name: "oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone/oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a" } file = sled-storage/src/manager.rs:1431
5352024-12-21T07:44:41.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362024-12-21T07:44:41.680ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372024-12-21T07:44:41.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone/oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e"), full_name: "oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone/oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e" } file = sled-storage/src/manager.rs:1431
5382024-12-21T07:44:41.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392024-12-21T07:44:41.757ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402024-12-21T07:44:41.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5412024-12-21T07:44:41.824ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422024-12-21T07:44:41.824ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5432024-12-21T07:44:41.824ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone" } file = sled-storage/src/manager.rs:1431
5442024-12-21T07:44:41.866ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452024-12-21T07:44:41.866ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462024-12-21T07:44:41.866ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crucible" } file = sled-storage/src/manager.rs:1431
5472024-12-21T07:44:41.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482024-12-21T07:44:41.934ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5492024-12-21T07:44:41.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/debug"), full_name: "oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/debug" } file = sled-storage/src/manager.rs:1431
5502024-12-21T07:44:41.949ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
5512024-12-21T07:44:41.973ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522024-12-21T07:44:41.974ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5532024-12-21T07:44:41.974ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5542024-12-21T07:44:42.044ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552024-12-21T07:44:42.044ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562024-12-21T07:44:42.044ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5572024-12-21T07:44:42.115ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582024-12-21T07:44:42.115ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5592024-12-21T07:44:42.115ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd7c5ec-686c-4ecd-8837-505154304410/crypt/debug"), full_name: "oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crypt/debug" } file = sled-storage/src/manager.rs:1431
5602024-12-21T07:44:42.157ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612024-12-21T07:44:42.157ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5622024-12-21T07:44:42.157ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone/oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone/oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0" } file = sled-storage/src/manager.rs:1431
5632024-12-21T07:44:42.234ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642024-12-21T07:44:42.234ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652024-12-21T07:44:42.234ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548" } file = sled-storage/src/manager.rs:1431
5662024-12-21T07:44:42.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672024-12-21T07:44:42.310ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5682024-12-21T07:44:42.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/debug"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/debug" } file = sled-storage/src/manager.rs:1431
5692024-12-21T07:44:42.349ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702024-12-21T07:44:42.349ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712024-12-21T07:44:42.349ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crucible" } file = sled-storage/src/manager.rs:1431
5722024-12-21T07:44:42.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732024-12-21T07:44:42.416ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742024-12-21T07:44:42.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone/oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone/oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912" } file = sled-storage/src/manager.rs:1431
5752024-12-21T07:44:42.493ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762024-12-21T07:44:42.493ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772024-12-21T07:44:42.493ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone/oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab"), full_name: "oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crypt/zone/oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab" } file = sled-storage/src/manager.rs:1431
5782024-12-21T07:44:42.578ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792024-12-21T07:44:42.578ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802024-12-21T07:44:42.578ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone/oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone/oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2" } file = sled-storage/src/manager.rs:1431
5812024-12-21T07:44:42.670ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822024-12-21T07:44:42.670ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832024-12-21T07:44:42.670ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e" } file = sled-storage/src/manager.rs:1431
5842024-12-21T07:44:42.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852024-12-21T07:44:42.757ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862024-12-21T07:44:42.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone/oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8"), full_name: "oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone/oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8" } file = sled-storage/src/manager.rs:1431
5872024-12-21T07:44:42.836ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882024-12-21T07:44:42.836ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892024-12-21T07:44:42.836ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e" } file = sled-storage/src/manager.rs:1431
5902024-12-21T07:44:42.901ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912024-12-21T07:44:42.901ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922024-12-21T07:44:42.901ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone/oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone/oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be" } file = sled-storage/src/manager.rs:1431
5932024-12-21T07:44:42.954ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
5942024-12-21T07:44:42.977ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952024-12-21T07:44:42.977ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962024-12-21T07:44:42.977ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5972024-12-21T07:44:43.045ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982024-12-21T07:44:43.045ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5992024-12-21T07:44:43.045ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone"), full_name: "oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/zone" } file = sled-storage/src/manager.rs:1431
6002024-12-21T07:44:43.078ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012024-12-21T07:44:43.078ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6022024-12-21T07:44:43.078ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/debug"), full_name: "oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/debug" } file = sled-storage/src/manager.rs:1431
6032024-12-21T07:44:43.110ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042024-12-21T07:44:43.110ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6052024-12-21T07:44:43.110ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/250ef3db-29d3-4600-be58-ffbaa8dc3798/crypt/zone/oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490"), full_name: "oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798/crypt/zone/oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490" } file = sled-storage/src/manager.rs:1431
6062024-12-21T07:44:43.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072024-12-21T07:44:43.182ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082024-12-21T07:44:43.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6092024-12-21T07:44:43.248ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102024-12-21T07:44:43.248ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112024-12-21T07:44:43.248ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone/oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8"), full_name: "oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone/oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8" } file = sled-storage/src/manager.rs:1431
6122024-12-21T07:44:43.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132024-12-21T07:44:43.327ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6142024-12-21T07:44:43.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crypt/debug"), full_name: "oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crypt/debug" } file = sled-storage/src/manager.rs:1431
6152024-12-21T07:44:43.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162024-12-21T07:44:43.365ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172024-12-21T07:44:43.365ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone/oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone/oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7" } file = sled-storage/src/manager.rs:1431
6182024-12-21T07:44:43.440ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192024-12-21T07:44:43.440ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202024-12-21T07:44:43.440ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d75297c3-49da-487f-a95f-88dc2681ce54/crypt/zone/oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f"), full_name: "oxp_d75297c3-49da-487f-a95f-88dc2681ce54/crypt/zone/oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f" } file = sled-storage/src/manager.rs:1431
6212024-12-21T07:44:43.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222024-12-21T07:44:43.517ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232024-12-21T07:44:43.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crypt/zone/oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8"), full_name: "oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crypt/zone/oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8" } file = sled-storage/src/manager.rs:1431
6242024-12-21T07:44:43.590ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252024-12-21T07:44:43.590ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262024-12-21T07:44:43.590ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone/oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2"), full_name: "oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/zone/oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2" } file = sled-storage/src/manager.rs:1431
6272024-12-21T07:44:43.668ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282024-12-21T07:44:43.668ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292024-12-21T07:44:43.668ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone/oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone/oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981" } file = sled-storage/src/manager.rs:1431
6302024-12-21T07:44:43.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312024-12-21T07:44:43.741ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6322024-12-21T07:44:43.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/250ef3db-29d3-4600-be58-ffbaa8dc3798/crypt/debug"), full_name: "oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798/crypt/debug" } file = sled-storage/src/manager.rs:1431
6332024-12-21T07:44:43.759ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.397022836s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
6342024-12-21T07:44:43.778ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352024-12-21T07:44:43.778ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362024-12-21T07:44:43.778ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6372024-12-21T07:44:43.846ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382024-12-21T07:44:43.846ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392024-12-21T07:44:43.846ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7"), full_name: "oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/zone/oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7" } file = sled-storage/src/manager.rs:1431
6402024-12-21T07:44:43.925ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412024-12-21T07:44:43.925ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422024-12-21T07:44:43.925ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crucible" } file = sled-storage/src/manager.rs:1431
6432024-12-21T07:44:43.956ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
6442024-12-21T07:44:43.990ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452024-12-21T07:44:43.990ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6462024-12-21T07:44:43.990ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone"), full_name: "oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/zone" } file = sled-storage/src/manager.rs:1431
6472024-12-21T07:44:44.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482024-12-21T07:44:44.028ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492024-12-21T07:44:44.028ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d75297c3-49da-487f-a95f-88dc2681ce54/crucible" } file = sled-storage/src/manager.rs:1431
6502024-12-21T07:44:44.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6512024-12-21T07:44:44.094ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6522024-12-21T07:44:44.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone"), full_name: "oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/zone" } file = sled-storage/src/manager.rs:1431
6532024-12-21T07:44:44.135ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542024-12-21T07:44:44.135ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552024-12-21T07:44:44.135ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
6562024-12-21T07:44:44.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4187581 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45574 req_id = 23972ebe-bf5a-4018-83e2-f6615ccf9126 response_code = 200 uri = /datasets
6572024-12-21T07:44:44.167ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 8f03505f-bf62-49dd-8281-80933bc24548 (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 481de7e8-0737-474b-8c33-e6e8bc6477be (service), filesystem_pool: Some(ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 683a9892-43cd-4dd8-a983-26cccd988df0 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6582024-12-21T07:44:44.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50538
6592024-12-21T07:44:44.167ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602024-12-21T07:44:44.167ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-12-21T07:44:44.177ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622024-12-21T07:44:44.177ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-12-21T07:44:44.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642024-12-21T07:44:44.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652024-12-21T07:44:44.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662024-12-21T07:44:44.194ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:188
6672024-12-21T07:44:44.194ZINFOSledAgent (ServiceManager): No ledger in /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:188
6682024-12-21T07:44:44.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-21T07:44:44.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-21T07:44:44.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712024-12-21T07:44:44.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722024-12-21T07:44:44.294ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548 file = illumos-utils/src/zone.rs:325
6732024-12-21T07:44:44.298ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be file = illumos-utils/src/zone.rs:325
6742024-12-21T07:44:44.302ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0 file = illumos-utils/src/zone.rs:325
6752024-12-21T07:44:44.314ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548 file = illumos-utils/src/zone.rs:363
6762024-12-21T07:44:44.319ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be file = illumos-utils/src/zone.rs:363
6772024-12-21T07:44:44.324ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0 file = illumos-utils/src/zone.rs:363
6782024-12-21T07:44:44.959ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
6792024-12-21T07:44:45.458ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6802024-12-21T07:44:45.458ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6812024-12-21T07:44:45.466ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6822024-12-21T07:44:45.466ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6832024-12-21T07:44:45.616ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
6842024-12-21T07:44:45.616ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
6852024-12-21T07:44:45.659ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
6862024-12-21T07:44:45.659ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
6872024-12-21T07:44:45.712ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
6882024-12-21T07:44:45.712ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
6892024-12-21T07:44:45.732ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
6902024-12-21T07:44:45.732ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
6912024-12-21T07:44:45.801ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
6922024-12-21T07:44:45.801ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
6932024-12-21T07:44:45.890ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
6942024-12-21T07:44:45.890ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6952024-12-21T07:44:45.923ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6962024-12-21T07:44:45.924ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13462928299659722521 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
6972024-12-21T07:44:45.924ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6305132308923777543 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
6982024-12-21T07:44:45.959ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6992024-12-21T07:44:45.959ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7002024-12-21T07:44:45.960ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7012024-12-21T07:44:45.960ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7022024-12-21T07:44:45.962ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7032024-12-21T07:44:46.007ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7042024-12-21T07:44:46.058ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7052024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7062024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7072024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7082024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7092024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7102024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7112024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7122024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7132024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7142024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7152024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7162024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7172024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7182024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7192024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7202024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7212024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7222024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7232024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7242024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7252024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7262024-12-21T07:44:46.058ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7272024-12-21T07:44:46.428ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46525
7282024-12-21T07:44:46.428ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46525 req_id = 47afafeb-a39f-4067-8d0e-ae498e1c9f66 response_code = 200 uri = /baseboard
7292024-12-21T07:44:46.440ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7302024-12-21T07:44:46.440ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7312024-12-21T07:44:46.440ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7322024-12-21T07:44:46.756ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
7332024-12-21T07:44:46.757ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
7342024-12-21T07:44:46.917ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7352024-12-21T07:44:46.917ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7362024-12-21T07:44:46.920ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7372024-12-21T07:44:46.924ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
7382024-12-21T07:44:46.924ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7392024-12-21T07:44:47.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 69.776679ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7402024-12-21T07:44:47.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 40.900257ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7412024-12-21T07:44:47.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 56.364945ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7422024-12-21T07:44:47.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 125.91858ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7432024-12-21T07:44:47.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 50.822608ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7442024-12-21T07:44:47.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 158.238763ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7452024-12-21T07:44:47.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 141.681169ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7462024-12-21T07:44:47.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 129.834353ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7472024-12-21T07:44:47.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 244.015711ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7482024-12-21T07:44:47.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 116.031392ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7492024-12-21T07:44:47.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 465.014038ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7502024-12-21T07:44:47.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 384.396688ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7512024-12-21T07:44:47.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 1.098993601s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7522024-12-21T07:44:48.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 787.253084ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7532024-12-21T07:44:48.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 641.732217ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7542024-12-21T07:44:48.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 1.495007415s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7552024-12-21T07:44:48.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 886.777168ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7562024-12-21T07:44:48.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 1.271890626s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7572024-12-21T07:44:49.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 935.316928ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7582024-12-21T07:44:50.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 1.359432602s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7592024-12-21T07:44:50.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 532.901128ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7602024-12-21T07:44:50.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 821.880109ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7612024-12-21T07:44:50.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 577.424568ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7622024-12-21T07:44:51.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 850.805138ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7632024-12-21T07:44:51.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 1.067357702s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7642024-12-21T07:44:51.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 1.095268648s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7652024-12-21T07:44:52.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be") failed: Property not found. retry in 1.339315586s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7662024-12-21T07:44:52.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0") failed: Property not found. retry in 1.46389714s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7672024-12-21T07:44:52.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 581.133484ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7682024-12-21T07:44:53.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548") failed: Property not found. retry in 517.789244ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7692024-12-21T07:44:54.136ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_8f03505f-bf62-49dd-8281-80933bc24548
7702024-12-21T07:44:54.136ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_481de7e8-0737-474b-8c33-e6e8bc6477be
7712024-12-21T07:44:54.136ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_683a9892-43cd-4dd8-a983-26cccd988df0
7722024-12-21T07:44:54.136ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7732024-12-21T07:44:54.136ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7742024-12-21T07:44:54.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9969047 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50538 req_id = 2d811a37-7ead-4512-b5e8-a10f30d4078e response_code = 204 uri = /omicron-zones
7752024-12-21T07:44:54.138ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7762024-12-21T07:44:55.927ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13462928299659722521 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
7772024-12-21T07:44:55.927ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6305132308923777543 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
7782024-12-21T07:44:56.758ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
7792024-12-21T07:44:56.758ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
7802024-12-21T07:44:57.594ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7812024-12-21T07:44:57.664ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7822024-12-21T07:44:57.790ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7832024-12-21T07:44:57.790ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7842024-12-21T07:44:57.822ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7852024-12-21T07:44:57.823ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7862024-12-21T07:44:57.823ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7872024-12-21T07:44:57.852ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 8f03505f-bf62-49dd-8281-80933bc24548 (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 481de7e8-0737-474b-8c33-e6e8bc6477be (service), filesystem_pool: Some(ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 683a9892-43cd-4dd8-a983-26cccd988df0 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: cda94d21-2d17-4750-82f2-3cd73c0711d3 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 45264313-3dfd-4989-866b-f3b222e88150, kind: Service { id: cda94d21-2d17-4750-82f2-3cd73c0711d3 }, name: Name("ntp-cda94d21-2d17-4750-82f2-3cd73c0711d3"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 104])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7882024-12-21T07:44:57.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55828
7892024-12-21T07:44:57.853ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7902024-12-21T07:44:57.853ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, responder: ... }
7912024-12-21T07:44:57.864ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7922024-12-21T07:44:57.864ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, responder: ... }
7932024-12-21T07:44:57.874ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7942024-12-21T07:44:57.874ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7952024-12-21T07:44:57.882ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7962024-12-21T07:44:57.882ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
7972024-12-21T07:44:57.883ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
7982024-12-21T07:44:57.883ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7992024-12-21T07:44:57.894ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8002024-12-21T07:44:57.926ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
8012024-12-21T07:44:57.927ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
8022024-12-21T07:44:57.927ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
8032024-12-21T07:44:57.956ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 150, 104]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
8042024-12-21T07:44:57.956ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
8052024-12-21T07:44:57.957ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
8062024-12-21T07:44:57.957ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8072024-12-21T07:44:57.957ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8082024-12-21T07:44:57.957ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8092024-12-21T07:44:57.978ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3 file = illumos-utils/src/zone.rs:325
8102024-12-21T07:44:57.997ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3 file = illumos-utils/src/zone.rs:363
8112024-12-21T07:44:58.603ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8122024-12-21T07:44:58.603ZINFOSledAgent (ServiceManager): Booting oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8132024-12-21T07:44:58.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 29.874948ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8142024-12-21T07:44:58.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 50.824571ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8152024-12-21T07:44:58.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 142.656773ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8162024-12-21T07:44:59.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 571.328ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8172024-12-21T07:44:59.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 488.079341ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8182024-12-21T07:45:00.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 1.200163784s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8192024-12-21T07:45:00.925ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/nexus.rs:527 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8202024-12-21T07:45:00.964ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8212024-12-21T07:45:01.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 1.406708398s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8222024-12-21T07:45:02.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 890.857235ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8232024-12-21T07:45:03.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3") failed: Property not found. retry in 573.799148ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8242024-12-21T07:45:03.662ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16367191495316561841 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8252024-12-21T07:45:03.819ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15257984184117988004 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8262024-12-21T07:45:04.138ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9069064356808623644 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8272024-12-21T07:45:04.203ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3
8282024-12-21T07:45:04.203ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8292024-12-21T07:45:04.204ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8302024-12-21T07:45:04.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6351379 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55828 req_id = 5799e638-1b36-488e-809b-dc436e91c4f0 response_code = 204 uri = /omicron-zones
8312024-12-21T07:45:04.206ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8322024-12-21T07:45:04.236ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8332024-12-21T07:45:04.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46589
8342024-12-21T07:45:04.247ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8352024-12-21T07:45:04.247ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10357 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46589 req_id = 8431112a-9ff3-41c2-955b-b530e1be9a31 response_code = 500 uri = /timesync
8362024-12-21T07:45:04.249ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372024-12-21T07:45:04.388ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382024-12-21T07:45:04.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56886
8392024-12-21T07:45:05.928ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13462928299659722521 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8402024-12-21T07:45:05.928ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6305132308923777543 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8412024-12-21T07:45:06.759ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8422024-12-21T07:45:06.760ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8432024-12-21T07:45:08.397ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8442024-12-21T07:45:08.397ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009493 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56886 req_id = c9e093b2-0eea-4924-9821-5bf5cd0f360f response_code = 500 uri = /timesync
8452024-12-21T07:45:08.400ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462024-12-21T07:45:08.513ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472024-12-21T07:45:08.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53264
8482024-12-21T07:45:08.522ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8492024-12-21T07:45:08.522ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53264 req_id = 8aa6acb8-e640-4b6c-b42f-ba97fc3ca9f6 response_code = 500 uri = /timesync
8502024-12-21T07:45:08.525ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512024-12-21T07:45:08.758ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522024-12-21T07:45:08.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43320
8532024-12-21T07:45:08.767ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cda94d21-2d17-4750-82f2-3cd73c0711d3': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8542024-12-21T07:45:08.767ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43320 req_id = f114a49e-f10e-4205-b676-26ef50535833 response_code = 500 uri = /timesync
8552024-12-21T07:45:08.769ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562024-12-21T07:45:09.014ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572024-12-21T07:45:09.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33076
8582024-12-21T07:45:10.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1009576 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33076 req_id = 565f4b0b-6fc4-40f5-9514-7df016653221 response_code = 200 uri = /timesync
8592024-12-21T07:45:10.027ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8602024-12-21T07:45:10.027ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612024-12-21T07:45:10.296ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622024-12-21T07:45:10.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45904
8632024-12-21T07:45:10.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45904 req_id = 241dc0a6-4ff0-45e4-af8d-a5659acae3e6 response_code = 200 uri = /timesync
8642024-12-21T07:45:10.308ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8652024-12-21T07:45:10.308ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662024-12-21T07:45:10.550ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672024-12-21T07:45:10.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44969
8682024-12-21T07:45:10.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8866 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44969 req_id = 0735ec35-c174-4f68-8868-86acf6d943bc response_code = 200 uri = /timesync
8692024-12-21T07:45:10.562ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8702024-12-21T07:45:10.562ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8712024-12-21T07:45:10.820ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8722024-12-21T07:45:10.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49639
8732024-12-21T07:45:10.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8508 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49639 req_id = 3db43ef0-5892-4862-91de-020b1ae64e88 response_code = 200 uri = /timesync
8742024-12-21T07:45:10.832ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8752024-12-21T07:45:10.832ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8762024-12-21T07:45:11.069ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8772024-12-21T07:45:11.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63226
8782024-12-21T07:45:11.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8638 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63226 req_id = 2f7d7556-e888-408b-88ff-b4966192f8d1 response_code = 200 uri = /timesync
8792024-12-21T07:45:11.080ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8802024-12-21T07:45:11.080ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8812024-12-21T07:45:11.349ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8822024-12-21T07:45:11.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32987
8832024-12-21T07:45:11.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8050 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32987 req_id = 67fac597-879d-49f3-90cd-99cdf5513887 response_code = 200 uri = /timesync
8842024-12-21T07:45:11.360ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8852024-12-21T07:45:11.360ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8862024-12-21T07:45:12.090ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8872024-12-21T07:45:12.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40609
8882024-12-21T07:45:12.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40609 req_id = cbfe403d-b1cf-4780-b61c-87fa1d210818 response_code = 200 uri = /timesync
8892024-12-21T07:45:12.100ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734767110.3106704, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8902024-12-21T07:45:12.100ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8912024-12-21T07:45:12.727ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8922024-12-21T07:45:12.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49666
8932024-12-21T07:45:12.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8965 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49666 req_id = d3f77d88-d521-47b2-b0f0-072284c3866d response_code = 200 uri = /timesync
8942024-12-21T07:45:12.739ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734767110.3106704, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8952024-12-21T07:45:12.739ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8962024-12-21T07:45:13.670ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16367191495316561841 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
8972024-12-21T07:45:13.750ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8982024-12-21T07:45:13.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53955
8992024-12-21T07:45:13.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53955 req_id = de8cbaac-1e1d-4e02-8c2d-9d4fe28487f2 response_code = 200 uri = /timesync
9002024-12-21T07:45:13.762ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734767110.3106704, correction: -0.184775293 } file = sled-agent/src/rack_setup/service.rs:743
9012024-12-21T07:45:13.762ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9022024-12-21T07:45:13.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15257984184117988004 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9032024-12-21T07:45:14.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9069064356808623644 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9042024-12-21T07:45:14.207ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12911762716858678539 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9052024-12-21T07:45:14.207ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15409939701914519523 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9062024-12-21T07:45:14.539ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9072024-12-21T07:45:14.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38102
9082024-12-21T07:45:14.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38102 req_id = 68f099fe-9936-4abb-8675-bdae93e2bfdb response_code = 200 uri = /timesync
9092024-12-21T07:45:14.549ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734767114.0149138, correction: -0.186185852 } file = sled-agent/src/rack_setup/service.rs:743
9102024-12-21T07:45:14.549ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9112024-12-21T07:45:15.209ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9122024-12-21T07:45:15.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64887
9132024-12-21T07:45:15.215ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 277.085934ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9142024-12-21T07:45:15.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9554 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64887 req_id = 7d8b0acf-4c0d-4fdc-8800-137c3fa47749 response_code = 200 uri = /timesync
9152024-12-21T07:45:15.221ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734767110.3106704, correction: -0.184362635 } file = sled-agent/src/rack_setup/service.rs:743
9162024-12-21T07:45:15.221ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9172024-12-21T07:45:15.897ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9182024-12-21T07:45:15.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34953
9192024-12-21T07:45:15.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9068 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34953 req_id = 87469260-bf1f-41fc-9aad-0e57a4b30cca response_code = 200 uri = /timesync
9202024-12-21T07:45:15.908ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734767110.3106704, correction: -0.182939142 } file = sled-agent/src/rack_setup/service.rs:743
9212024-12-21T07:45:15.908ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9222024-12-21T07:45:15.929ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13462928299659722521 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9232024-12-21T07:45:15.929ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6305132308923777543 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9242024-12-21T07:45:16.459ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50037
9252024-12-21T07:45:16.460ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50037 req_id = 1fb0f151-e737-4cd9-bdde-760c54010c8a response_code = 200 uri = /baseboard
9262024-12-21T07:45:16.757ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9272024-12-21T07:45:16.757ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9282024-12-21T07:45:17.425ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9292024-12-21T07:45:17.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60994
9302024-12-21T07:45:17.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8614 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60994 req_id = cff9d156-4b6a-48e1-85f9-c084ba1a7a11 response_code = 200 uri = /timesync
9312024-12-21T07:45:17.438ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734767115.2235065, correction: -0.179051965 } file = sled-agent/src/rack_setup/service.rs:743
9322024-12-21T07:45:17.438ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9332024-12-21T07:45:18.893ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9342024-12-21T07:45:18.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50533
9352024-12-21T07:45:18.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8653 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50533 req_id = dd6f6e00-647d-430a-95f0-d555c6daa3de response_code = 200 uri = /timesync
9362024-12-21T07:45:18.905ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734767117.8845413, correction: -0.17528969 } file = sled-agent/src/rack_setup/service.rs:743
9372024-12-21T07:45:18.905ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9382024-12-21T07:45:20.179ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9392024-12-21T07:45:20.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60330
9402024-12-21T07:45:20.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8834 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60330 req_id = ea47100d-d3b8-465c-ab97-59eff51b40da response_code = 200 uri = /timesync
9412024-12-21T07:45:20.191ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734767118.526218, correction: -0.171752304 } file = sled-agent/src/rack_setup/service.rs:743
9422024-12-21T07:45:20.191ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9432024-12-21T07:45:22.306ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9442024-12-21T07:45:22.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49283
9452024-12-21T07:45:22.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49283 req_id = 4ada653d-83a5-4a27-ba8b-611b8a77e280 response_code = 200 uri = /timesync
9462024-12-21T07:45:22.318ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734767121.0416534, correction: -0.165995374 } file = sled-agent/src/rack_setup/service.rs:743
9472024-12-21T07:45:22.318ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9482024-12-21T07:45:23.644ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16367191495316561841 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9492024-12-21T07:45:23.799ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15257984184117988004 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9502024-12-21T07:45:24.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9069064356808623644 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9512024-12-21T07:45:24.181ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12911762716858678539 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9522024-12-21T07:45:24.181ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15409939701914519523 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9532024-12-21T07:45:24.301ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9542024-12-21T07:45:24.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63455
9552024-12-21T07:45:24.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8752 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63455 req_id = 69b9d47a-9965-446f-9e0d-301073c348fd response_code = 200 uri = /timesync
9562024-12-21T07:45:24.314ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734767122.4089406, correction: -0.160434023 } file = sled-agent/src/rack_setup/service.rs:743
9572024-12-21T07:45:24.314ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9582024-12-21T07:45:25.903ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13462928299659722521 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9592024-12-21T07:45:25.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6305132308923777543 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9602024-12-21T07:45:26.603ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9612024-12-21T07:45:26.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47648
9622024-12-21T07:45:26.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47648 req_id = 320c0a6c-0430-4535-ae5c-3afa4bfa83e9 response_code = 200 uri = /timesync
9632024-12-21T07:45:26.615ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734767125.4250758, correction: -0.149630114 } file = sled-agent/src/rack_setup/service.rs:743
9642024-12-21T07:45:26.615ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9652024-12-21T07:45:26.731ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9662024-12-21T07:45:26.731ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9672024-12-21T07:45:30.187ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9682024-12-21T07:45:30.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55325
9692024-12-21T07:45:30.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8970 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55325 req_id = b2e77831-cd38-4ebf-a608-1abf7a03bebd response_code = 200 uri = /timesync
9702024-12-21T07:45:30.199ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126907, ip_addr: 23.141.40.123, stratum: 3, ref_time: 1734767129.3380928, correction: -0.151342586 } file = sled-agent/src/rack_setup/service.rs:743
9712024-12-21T07:45:30.199ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9722024-12-21T07:45:30.485ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 590.413067ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9732024-12-21T07:45:33.619ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16367191495316561841 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9742024-12-21T07:45:33.774ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15257984184117988004 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9752024-12-21T07:45:33.946ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9762024-12-21T07:45:33.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48944
9772024-12-21T07:45:33.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48944 req_id = 59f45839-51a1-41be-9dc7-6b2563357101 response_code = 200 uri = /timesync
9782024-12-21T07:45:33.958ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126907, ip_addr: 23.141.40.123, stratum: 3, ref_time: 1734767132.8040144, correction: -0.141151249 } file = sled-agent/src/rack_setup/service.rs:743
9792024-12-21T07:45:33.958ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9802024-12-21T07:45:34.091ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9069064356808623644 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9812024-12-21T07:45:34.154ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12911762716858678539 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9822024-12-21T07:45:34.154ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15409939701914519523 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9832024-12-21T07:45:35.877ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13462928299659722521 reason = Duration(60s) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9842024-12-21T07:45:35.878ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6305132308923777543 reason = Duration(60s) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9852024-12-21T07:45:36.705ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9862024-12-21T07:45:36.705ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9872024-12-21T07:45:38.045ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9882024-12-21T07:45:38.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58782
9892024-12-21T07:45:38.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8960 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58782 req_id = 3bc3a999-21eb-41fa-8f35-b4e4c3009333 response_code = 200 uri = /timesync
9902024-12-21T07:45:38.056ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126907, ip_addr: 23.141.40.123, stratum: 3, ref_time: 1734767137.4336803, correction: -0.129624739 } file = sled-agent/src/rack_setup/service.rs:743
9912024-12-21T07:45:38.056ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9922024-12-21T07:45:43.592ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16367191495316561841 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9932024-12-21T07:45:43.747ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15257984184117988004 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9942024-12-21T07:45:44.064ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9069064356808623644 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9952024-12-21T07:45:44.127ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12911762716858678539 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9962024-12-21T07:45:44.127ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15409939701914519523 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
9972024-12-21T07:45:45.784ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9982024-12-21T07:45:45.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38880
9992024-12-21T07:45:45.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38880 req_id = d8686010-b239-479d-8c35-bc6311d2300d response_code = 200 uri = /timesync
10002024-12-21T07:45:45.795ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1734767144.111411, correction: -0.09892901 } file = sled-agent/src/rack_setup/service.rs:743
10012024-12-21T07:45:45.795ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10022024-12-21T07:45:46.068ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 571.026118ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10032024-12-21T07:45:46.410ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61025
10042024-12-21T07:45:46.410ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61025 req_id = ddd8a7e3-bcec-4f18-99ab-1ea814b4fee7 response_code = 200 uri = /baseboard
10052024-12-21T07:45:46.680ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10062024-12-21T07:45:46.680ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10072024-12-21T07:45:53.353ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10082024-12-21T07:45:53.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41909
10092024-12-21T07:45:53.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8638 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41909 req_id = 1488971f-f661-4c13-8758-4c1b6f6b34da response_code = 200 uri = /timesync
10102024-12-21T07:45:53.365ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1734767152.5873115, correction: -0.078389041 } file = sled-agent/src/rack_setup/service.rs:743
10112024-12-21T07:45:53.365ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10122024-12-21T07:45:53.567ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16367191495316561841 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10132024-12-21T07:45:53.722ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15257984184117988004 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10142024-12-21T07:45:54.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9069064356808623644 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10152024-12-21T07:45:54.100ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12911762716858678539 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10162024-12-21T07:45:54.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15409939701914519523 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10172024-12-21T07:45:56.654ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6830994259924042462 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10182024-12-21T07:45:56.655ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 442573766479485353 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10192024-12-21T07:46:01.633ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.360731168s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10202024-12-21T07:46:03.542ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16367191495316561841 reason = Duration(60s) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10212024-12-21T07:46:03.697ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15257984184117988004 reason = Duration(60s) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10222024-12-21T07:46:04.012ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9069064356808623644 reason = Duration(60s) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10232024-12-21T07:46:04.074ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12911762716858678539 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10242024-12-21T07:46:04.075ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15409939701914519523 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10252024-12-21T07:46:06.528ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10262024-12-21T07:46:06.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37266
10272024-12-21T07:46:06.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21858 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37266 req_id = 6a61ee9f-55a7-4449-947d-39e0828b18a4 response_code = 200 uri = /timesync
10282024-12-21T07:46:06.552ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T07:46:04.012537063Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9069064356808623644 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10292024-12-21T07:46:06.552ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T07:46:03.542575070Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16367191495316561841 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10302024-12-21T07:46:06.552ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T07:46:03.697059308Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15257984184117988004 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10312024-12-21T07:46:06.553ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T07:45:35.878369476Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6305132308923777543 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10322024-12-21T07:46:06.553ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T07:45:35.877670214Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13462928299659722521 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
10332024-12-21T07:46:06.554ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1734767165.7442305, correction: -0.039921656 } file = sled-agent/src/rack_setup/service.rs:743
10342024-12-21T07:46:06.554ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10352024-12-21T07:46:06.583ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 8f03505f-bf62-49dd-8281-80933bc24548 (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 481de7e8-0737-474b-8c33-e6e8bc6477be (service), filesystem_pool: Some(ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 683a9892-43cd-4dd8-a983-26cccd988df0 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: cda94d21-2d17-4750-82f2-3cd73c0711d3 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 45264313-3dfd-4989-866b-f3b222e88150, kind: Service { id: cda94d21-2d17-4750-82f2-3cd73c0711d3 }, name: Name("ntp-cda94d21-2d17-4750-82f2-3cd73c0711d3"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 104])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 67247833-e0f4-4b9e-87e4-1a895ec9179e (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } } } }, OmicronZoneConfig { id: 3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2 (service), filesystem_pool: Some(ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } } } }, OmicronZoneConfig { id: 3594f15d-8f67-4231-a06a-6ce56be8e1e7 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8afd6b49-1f66-4a53-9392-2436dee7003a (service), filesystem_pool: Some(ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External } } } }, OmicronZoneConfig { id: a5538b60-fba7-46de-9310-b5943e9117a2 (service), filesystem_pool: Some(ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10362024-12-21T07:46:06.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59681
10372024-12-21T07:46:06.584ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10382024-12-21T07:46:06.584ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, responder: ... }
10392024-12-21T07:46:06.594ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10402024-12-21T07:46:06.594ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, responder: ... }
10412024-12-21T07:46:06.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10422024-12-21T07:46:06.604ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10432024-12-21T07:46:06.614ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10442024-12-21T07:46:06.614ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452024-12-21T07:46:06.624ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10462024-12-21T07:46:06.624ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472024-12-21T07:46:06.634ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10482024-12-21T07:46:06.634ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492024-12-21T07:46:06.642ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10502024-12-21T07:46:06.643ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10512024-12-21T07:46:06.651ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10522024-12-21T07:46:06.651ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10532024-12-21T07:46:06.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10542024-12-21T07:46:06.660ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
10552024-12-21T07:46:06.660ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
10562024-12-21T07:46:06.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10572024-12-21T07:46:06.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10582024-12-21T07:46:06.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10592024-12-21T07:46:06.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10602024-12-21T07:46:06.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10612024-12-21T07:46:06.740ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10622024-12-21T07:46:06.823ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2 file = illumos-utils/src/zone.rs:325
10632024-12-21T07:46:06.827ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a file = illumos-utils/src/zone.rs:325
10642024-12-21T07:46:06.831ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2 file = illumos-utils/src/zone.rs:325
10652024-12-21T07:46:06.836ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7 file = illumos-utils/src/zone.rs:325
10662024-12-21T07:46:06.840ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e file = illumos-utils/src/zone.rs:325
10672024-12-21T07:46:06.845ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2 file = illumos-utils/src/zone.rs:363
10682024-12-21T07:46:06.849ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a file = illumos-utils/src/zone.rs:363
10692024-12-21T07:46:06.853ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2 file = illumos-utils/src/zone.rs:363
10702024-12-21T07:46:06.857ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7 file = illumos-utils/src/zone.rs:363
10712024-12-21T07:46:06.863ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e file = illumos-utils/src/zone.rs:363
10722024-12-21T07:46:10.383ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='67247833-e0f4-4b9e-87e4-1a895ec9179e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10732024-12-21T07:46:10.383ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
10742024-12-21T07:46:10.415ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10752024-12-21T07:46:10.416ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
10762024-12-21T07:46:10.421ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8afd6b49-1f66-4a53-9392-2436dee7003a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10772024-12-21T07:46:10.421ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
10782024-12-21T07:46:10.457ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3594f15d-8f67-4231-a06a-6ce56be8e1e7'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10792024-12-21T07:46:10.457ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
10802024-12-21T07:46:10.465ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a5538b60-fba7-46de-9310-b5943e9117a2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10812024-12-21T07:46:10.465ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
10822024-12-21T07:46:10.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 50.400375ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
10832024-12-21T07:46:10.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 39.990977ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
10842024-12-21T07:46:10.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 29.507409ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
10852024-12-21T07:46:10.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 64.686758ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
10862024-12-21T07:46:10.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 35.594548ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
10872024-12-21T07:46:10.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 69.426126ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
10882024-12-21T07:46:10.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 61.363086ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
10892024-12-21T07:46:10.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 149.492074ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
10902024-12-21T07:46:11.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 52.125011ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
10912024-12-21T07:46:11.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 141.90769ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
10922024-12-21T07:46:11.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 270.909593ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
10932024-12-21T07:46:11.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 194.393752ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
10942024-12-21T07:46:11.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 201.84921ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
10952024-12-21T07:46:11.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 189.982723ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
10962024-12-21T07:46:11.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 160.573555ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
10972024-12-21T07:46:11.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 238.553037ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
10982024-12-21T07:46:11.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 277.287824ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
10992024-12-21T07:46:11.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 433.685929ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11002024-12-21T07:46:11.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 378.181262ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11012024-12-21T07:46:11.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 436.327048ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11022024-12-21T07:46:11.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 738.219456ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11032024-12-21T07:46:11.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 1.034376565s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11042024-12-21T07:46:12.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 401.985741ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11052024-12-21T07:46:12.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 609.602041ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11062024-12-21T07:46:12.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 413.201589ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11072024-12-21T07:46:12.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 1.272766675s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11082024-12-21T07:46:12.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 1.159268605s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11092024-12-21T07:46:12.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 520.679492ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11102024-12-21T07:46:12.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 939.699243ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11112024-12-21T07:46:12.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 601.134006ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11122024-12-21T07:46:13.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 1.042921642s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11132024-12-21T07:46:13.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 1.097093116s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11142024-12-21T07:46:13.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 888.984172ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11152024-12-21T07:46:13.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 1.000108896s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11162024-12-21T07:46:13.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 561.692591ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11172024-12-21T07:46:14.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 1.185401751s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11182024-12-21T07:46:14.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 585.978519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11192024-12-21T07:46:14.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 536.768702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11202024-12-21T07:46:14.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 813.64199ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11212024-12-21T07:46:14.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 963.340631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11222024-12-21T07:46:14.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 518.135471ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11232024-12-21T07:46:15.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 690.093322ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11242024-12-21T07:46:15.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 551.636314ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11252024-12-21T07:46:15.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 1.040603413s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11262024-12-21T07:46:15.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 518.554783ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11272024-12-21T07:46:15.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 500.696199ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11282024-12-21T07:46:15.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 862.782724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11292024-12-21T07:46:15.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 514.096702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11302024-12-21T07:46:16.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 584.320492ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11312024-12-21T07:46:16.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 1.302147032s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11322024-12-21T07:46:16.364ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37960
11332024-12-21T07:46:16.364ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37960 req_id = 5c54dc91-8ffd-4828-8b08-b28f44bc69f7 response_code = 200 uri = /baseboard
11342024-12-21T07:46:16.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 942.43135ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11352024-12-21T07:46:16.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 937.121077ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11362024-12-21T07:46:16.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 666.460322ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11372024-12-21T07:46:16.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 569.564928ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11382024-12-21T07:46:17.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e") failed: Property not found. retry in 1.445288443s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11392024-12-21T07:46:17.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7") failed: Property not found. retry in 654.460297ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11402024-12-21T07:46:17.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 872.79648ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11412024-12-21T07:46:17.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 806.050399ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11422024-12-21T07:46:17.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2") failed: Property not found. retry in 1.013212611s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11432024-12-21T07:46:17.986ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.0746468s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
11442024-12-21T07:46:18.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 502.913309ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11452024-12-21T07:46:18.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 1.337708054s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11462024-12-21T07:46:18.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 522.727429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11472024-12-21T07:46:19.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 1.285078991s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11482024-12-21T07:46:19.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 1.156711491s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11492024-12-21T07:46:20.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 719.118355ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11502024-12-21T07:46:21.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 1.412483687s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11512024-12-21T07:46:21.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 1.138882639s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11522024-12-21T07:46:22.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 623.957742ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11532024-12-21T07:46:22.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 1.368505925s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11542024-12-21T07:46:23.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 1.117742332s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11552024-12-21T07:46:24.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 1.1241132s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11562024-12-21T07:46:24.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 1.424150727s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11572024-12-21T07:46:25.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 817.091308ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11582024-12-21T07:46:25.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 1.237790987s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11592024-12-21T07:46:26.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 1.226505561s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11602024-12-21T07:46:26.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a") failed: Property not found. retry in 1.009815298s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11612024-12-21T07:46:27.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2") failed: Property not found. retry in 635.487456ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11622024-12-21T07:46:28.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_a5538b60-fba7-46de-9310-b5943e9117a2
11632024-12-21T07:46:28.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_8afd6b49-1f66-4a53-9392-2436dee7003a
11642024-12-21T07:46:28.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2
11652024-12-21T07:46:28.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_3594f15d-8f67-4231-a06a-6ce56be8e1e7
11662024-12-21T07:46:28.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_67247833-e0f4-4b9e-87e4-1a895ec9179e
11672024-12-21T07:46:28.010ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11682024-12-21T07:46:28.010ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11692024-12-21T07:46:28.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21465682 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59681 req_id = 6b495ef6-cf32-48d7-932f-6a48ed0e7c57 response_code = 204 uri = /omicron-zones
11702024-12-21T07:46:28.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35651
11712024-12-21T07:46:28.076ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3758
11722024-12-21T07:46:28.261ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
11732024-12-21T07:46:33.056ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
11742024-12-21T07:46:33.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5007492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35651 req_id = 8cc27d25-3c32-49d3-baa1-452c556f11c1 response_code = 204 uri = /cockroachdb
11752024-12-21T07:46:33.105ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 8f03505f-bf62-49dd-8281-80933bc24548 (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 481de7e8-0737-474b-8c33-e6e8bc6477be (service), filesystem_pool: Some(ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 683a9892-43cd-4dd8-a983-26cccd988df0 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: cda94d21-2d17-4750-82f2-3cd73c0711d3 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 45264313-3dfd-4989-866b-f3b222e88150, kind: Service { id: cda94d21-2d17-4750-82f2-3cd73c0711d3 }, name: Name("ntp-cda94d21-2d17-4750-82f2-3cd73c0711d3"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 104])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 67247833-e0f4-4b9e-87e4-1a895ec9179e (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } } } }, OmicronZoneConfig { id: 3f8304ec-d19e-4e4d-8e47-0cd6273cc3f2 (service), filesystem_pool: Some(ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } } } }, OmicronZoneConfig { id: 3594f15d-8f67-4231-a06a-6ce56be8e1e7 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8afd6b49-1f66-4a53-9392-2436dee7003a (service), filesystem_pool: Some(ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External } } } }, OmicronZoneConfig { id: a5538b60-fba7-46de-9310-b5943e9117a2 (service), filesystem_pool: Some(ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 (service), filesystem_pool: Some(ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd (service), filesystem_pool: Some(ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4b205886-0970-4a9e-bff0-ae1192504434 (service), filesystem_pool: Some(ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: cd9693cc-b2a2-4b9b-beee-fc2908a9238e (service), filesystem_pool: Some(ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 85673d8a-2e64-480d-8b22-5ecb66c02468 (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } } } }, OmicronZoneConfig { id: 81201a68-4f2b-422c-8aca-1b05de438ba8 (service), filesystem_pool: Some(ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 03b723f9-dc36-4197-af85-09d96793295e (service), filesystem_pool: Some(ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 0d887b58-d2d3-498a-b734-4ce0aa0e52d6 (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: d20dc299-451b-4507-a4d3-397fc1c3b571 (service), filesystem_pool: Some(ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External } } } }, OmicronZoneConfig { id: 35eb2ffd-7287-4600-9dc9-0915d4b9d981 (service), filesystem_pool: Some(ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External } } } }, OmicronZoneConfig { id: 6eaeb9f0-f302-479e-96a2-0b6de3fd3912 (service), filesystem_pool: Some(ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab (service), filesystem_pool: Some(ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External } } } }, OmicronZoneConfig { id: c46fcdda-0c08-4172-b4f8-02e5f76bd6d8 (service), filesystem_pool: Some(ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External } } } }, OmicronZoneConfig { id: fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8 (service), filesystem_pool: Some(ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External } } } }, OmicronZoneConfig { id: a7fd0ff0-5ae3-4ea4-83e5-492b795a529f (service), filesystem_pool: Some(ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External } } } }, OmicronZoneConfig { id: cfa42fd9-c7b7-49ce-9606-f6ff6f004490 (service), filesystem_pool: Some(ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2858b358-7183-451f-b471-559976754305 (service), filesystem_pool: Some(ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11762024-12-21T07:46:33.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40288
11772024-12-21T07:46:33.106ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11782024-12-21T07:46:33.106ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: InternalDns }, responder: ... }
11792024-12-21T07:46:33.124ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11802024-12-21T07:46:33.124ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: InternalDns }, responder: ... }
11812024-12-21T07:46:33.140ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11822024-12-21T07:46:33.140ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11832024-12-21T07:46:33.154ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11842024-12-21T07:46:33.154ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Cockroach }, responder: ... }
11852024-12-21T07:46:33.170ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11862024-12-21T07:46:33.170ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Cockroach }, responder: ... }
11872024-12-21T07:46:33.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11882024-12-21T07:46:33.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11892024-12-21T07:46:33.199ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11902024-12-21T07:46:33.199ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11912024-12-21T07:46:33.215ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11922024-12-21T07:46:33.215ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11932024-12-21T07:46:33.229ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11942024-12-21T07:46:33.229ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11952024-12-21T07:46:33.243ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11962024-12-21T07:46:33.243ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11972024-12-21T07:46:33.259ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11982024-12-21T07:46:33.259ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11992024-12-21T07:46:33.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12002024-12-21T07:46:33.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, kind: Crucible }, responder: ... }
12012024-12-21T07:46:33.290ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12022024-12-21T07:46:33.290ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, kind: Crucible }, responder: ... }
12032024-12-21T07:46:33.306ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12042024-12-21T07:46:33.306ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, kind: Crucible }, responder: ... }
12052024-12-21T07:46:33.321ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12062024-12-21T07:46:33.321ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, kind: Crucible }, responder: ... }
12072024-12-21T07:46:33.336ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12082024-12-21T07:46:33.337ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, kind: Crucible }, responder: ... }
12092024-12-21T07:46:33.352ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12102024-12-21T07:46:33.352ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, kind: Crucible }, responder: ... }
12112024-12-21T07:46:33.367ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12122024-12-21T07:46:33.368ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, kind: Crucible }, responder: ... }
12132024-12-21T07:46:33.382ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12142024-12-21T07:46:33.382ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, kind: Crucible }, responder: ... }
12152024-12-21T07:46:33.398ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12162024-12-21T07:46:33.398ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, kind: Crucible }, responder: ... }
12172024-12-21T07:46:33.414ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12182024-12-21T07:46:33.414ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
12192024-12-21T07:46:33.414ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
12202024-12-21T07:46:33.414ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212024-12-21T07:46:33.570ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12222024-12-21T07:46:33.570ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12232024-12-21T07:46:33.575ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12242024-12-21T07:46:33.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12252024-12-21T07:46:33.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12262024-12-21T07:46:33.632ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12272024-12-21T07:46:33.632ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12282024-12-21T07:46:33.632ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12292024-12-21T07:46:33.632ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12302024-12-21T07:46:33.652ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12312024-12-21T07:46:33.918ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12322024-12-21T07:46:33.918ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12332024-12-21T07:46:33.918ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12342024-12-21T07:46:33.918ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12352024-12-21T07:46:33.918ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12362024-12-21T07:46:33.918ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12372024-12-21T07:46:33.946ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12382024-12-21T07:46:33.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12392024-12-21T07:46:33.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12402024-12-21T07:46:33.947ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571 file = illumos-utils/src/zone.rs:325
12412024-12-21T07:46:33.951ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e file = illumos-utils/src/zone.rs:325
12422024-12-21T07:46:33.957ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6 file = illumos-utils/src/zone.rs:325
12432024-12-21T07:46:33.964ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = illumos-utils/src/zone.rs:325
12442024-12-21T07:46:33.971ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912 file = illumos-utils/src/zone.rs:325
12452024-12-21T07:46:33.977ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab file = illumos-utils/src/zone.rs:325
12462024-12-21T07:46:33.983ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8 file = illumos-utils/src/zone.rs:325
12472024-12-21T07:46:34.145ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571 file = illumos-utils/src/zone.rs:363
12482024-12-21T07:46:34.151ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e file = illumos-utils/src/zone.rs:363
12492024-12-21T07:46:34.156ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6 file = illumos-utils/src/zone.rs:363
12502024-12-21T07:46:34.161ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = illumos-utils/src/zone.rs:363
12512024-12-21T07:46:34.166ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912 file = illumos-utils/src/zone.rs:363
12522024-12-21T07:46:34.171ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab file = illumos-utils/src/zone.rs:363
12532024-12-21T07:46:34.176ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8 file = illumos-utils/src/zone.rs:363
12542024-12-21T07:46:34.181ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8 file = illumos-utils/src/zone.rs:325
12552024-12-21T07:46:34.188ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981 file = illumos-utils/src/zone.rs:325
12562024-12-21T07:46:34.193ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f file = illumos-utils/src/zone.rs:325
12572024-12-21T07:46:34.198ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2858b358-7183-451f-b471-559976754305 file = illumos-utils/src/zone.rs:325
12582024-12-21T07:46:34.204ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468 file = illumos-utils/src/zone.rs:325
12592024-12-21T07:46:34.211ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8 file = illumos-utils/src/zone.rs:325
12602024-12-21T07:46:34.217ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490 file = illumos-utils/src/zone.rs:325
12612024-12-21T07:46:34.281ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12622024-12-21T07:46:34.335ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12632024-12-21T07:46:34.335ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8 file = illumos-utils/src/zone.rs:363
12642024-12-21T07:46:34.345ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981 file = illumos-utils/src/zone.rs:363
12652024-12-21T07:46:34.352ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f file = illumos-utils/src/zone.rs:363
12662024-12-21T07:46:34.358ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2858b358-7183-451f-b471-559976754305 file = illumos-utils/src/zone.rs:363
12672024-12-21T07:46:34.365ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468 file = illumos-utils/src/zone.rs:363
12682024-12-21T07:46:34.374ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8 file = illumos-utils/src/zone.rs:363
12692024-12-21T07:46:34.381ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490 file = illumos-utils/src/zone.rs:363
12702024-12-21T07:46:34.447ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12712024-12-21T07:46:34.502ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12722024-12-21T07:46:34.506ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12732024-12-21T07:46:34.506ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12742024-12-21T07:46:34.558ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 138, 69]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12752024-12-21T07:46:34.558ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12762024-12-21T07:46:34.560ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12772024-12-21T07:46:34.560ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12782024-12-21T07:46:34.616ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 152, 223]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12792024-12-21T07:46:34.616ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12802024-12-21T07:46:34.705ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12812024-12-21T07:46:34.708ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12822024-12-21T07:46:34.708ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12832024-12-21T07:46:34.763ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 230, 193]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12842024-12-21T07:46:34.763ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12852024-12-21T07:46:34.763ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12862024-12-21T07:46:34.763ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12872024-12-21T07:46:34.764ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12882024-12-21T07:46:34.764ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12892024-12-21T07:46:34.765ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12902024-12-21T07:46:34.765ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12912024-12-21T07:46:34.820ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 136, 45]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12922024-12-21T07:46:34.820ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12932024-12-21T07:46:34.822ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12942024-12-21T07:46:34.822ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12952024-12-21T07:46:34.890ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 233, 205]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12962024-12-21T07:46:34.890ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12972024-12-21T07:46:34.891ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12982024-12-21T07:46:34.892ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12992024-12-21T07:46:34.896ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13002024-12-21T07:46:34.896ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13012024-12-21T07:46:35.037ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd file = illumos-utils/src/zone.rs:325
13022024-12-21T07:46:35.058ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13032024-12-21T07:46:35.059ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13042024-12-21T07:46:35.059ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13052024-12-21T07:46:35.059ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13062024-12-21T07:46:35.059ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13072024-12-21T07:46:35.059ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13082024-12-21T07:46:35.059ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7 file = illumos-utils/src/zone.rs:325
13092024-12-21T07:46:35.072ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13102024-12-21T07:46:35.074ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13112024-12-21T07:46:35.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13122024-12-21T07:46:35.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13132024-12-21T07:46:35.079ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13142024-12-21T07:46:35.102ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.870119296s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
13152024-12-21T07:46:35.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13162024-12-21T07:46:35.200ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd file = illumos-utils/src/zone.rs:363
13172024-12-21T07:46:35.207ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7 file = illumos-utils/src/zone.rs:363
13182024-12-21T07:46:35.212ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35 file = illumos-utils/src/zone.rs:325
13192024-12-21T07:46:35.219ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e file = illumos-utils/src/zone.rs:325
13202024-12-21T07:46:35.225ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434 file = illumos-utils/src/zone.rs:325
13212024-12-21T07:46:35.242ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35 file = illumos-utils/src/zone.rs:363
13222024-12-21T07:46:35.250ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e file = illumos-utils/src/zone.rs:363
13232024-12-21T07:46:35.257ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434 file = illumos-utils/src/zone.rs:363
13242024-12-21T07:46:35.737ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13252024-12-21T07:46:35.739ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
13262024-12-21T07:46:35.949ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bf957a6f-73b3-4118-885c-8d99dd0a7aad'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13272024-12-21T07:46:35.949ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
13282024-12-21T07:46:36.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 65.335119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
13292024-12-21T07:46:36.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 74.773194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
13302024-12-21T07:46:36.799ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dc55f0c3-190b-4fd2-beb3-866bdac9248a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13312024-12-21T07:46:36.799ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
13322024-12-21T07:46:41.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 183.645032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
13332024-12-21T07:46:41.392ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9cd7c5ec-686c-4ecd-8837-505154304410/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='77e72270-6696-4003-a66f-42c3bc6bfd01'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13342024-12-21T07:46:41.392ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='307b45dc-5f50-4214-aee8-c0091eedd979'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13352024-12-21T07:46:41.412ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
13362024-12-21T07:46:41.487ZINFOSledAgent (ServiceManager): Booting oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
13372024-12-21T07:46:41.588ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='009d862c-b55b-4116-b5f6-1a1f1750b4d4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13382024-12-21T07:46:41.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 32.554926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
13392024-12-21T07:46:41.603ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d75297c3-49da-487f-a95f-88dc2681ce54/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4617ab13-a072-4c30-99fb-9371cb97422f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13402024-12-21T07:46:41.689ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
13412024-12-21T07:46:41.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 567.169377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
13422024-12-21T07:46:41.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 86.257289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
13432024-12-21T07:46:41.961ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
13442024-12-21T07:46:42.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 101.941123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
13452024-12-21T07:46:42.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 58.103339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
13462024-12-21T07:46:42.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 27.746366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
13472024-12-21T07:46:42.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 71.163506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
13482024-12-21T07:46:42.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 106.977058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
13492024-12-21T07:46:42.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 476.526875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
13502024-12-21T07:46:42.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 148.106158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
13512024-12-21T07:46:42.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 908.97477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
13522024-12-21T07:46:42.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 107.840455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
13532024-12-21T07:46:42.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 115.085721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
13542024-12-21T07:46:42.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 74.026793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
13552024-12-21T07:46:42.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 43.448475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
13562024-12-21T07:46:42.523ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='cd9693cc-b2a2-4b9b-beee-fc2908a9238e'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572024-12-21T07:46:42.523ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
13582024-12-21T07:46:42.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 83.817212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
13592024-12-21T07:46:42.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 55.611386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
13602024-12-21T07:46:42.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 418.055587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
13612024-12-21T07:46:42.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 163.432327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
13622024-12-21T07:46:42.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 164.353918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
13632024-12-21T07:46:42.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 269.747631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
13642024-12-21T07:46:42.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 286.309833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
13652024-12-21T07:46:42.768ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b60a053f-a487-478b-a303-36c69c2e6544'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13662024-12-21T07:46:42.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 52.792804ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
13672024-12-21T07:46:42.946ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
13682024-12-21T07:46:42.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.134697425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
13692024-12-21T07:46:42.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 221.141164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
13702024-12-21T07:46:42.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 330.936269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
13712024-12-21T07:46:43.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 273.174597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
13722024-12-21T07:46:43.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 557.430677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
13732024-12-21T07:46:43.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 126.324196ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
13742024-12-21T07:46:43.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.014249077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
13752024-12-21T07:46:43.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 229.929848ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
13762024-12-21T07:46:43.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 525.318113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
13772024-12-21T07:46:43.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 535.850578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
13782024-12-21T07:46:43.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 43.56891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
13792024-12-21T07:46:43.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.059752764s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
13802024-12-21T07:46:43.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.305536032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
13812024-12-21T07:46:43.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 113.800979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
13822024-12-21T07:46:43.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 592.847452ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
13832024-12-21T07:46:43.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 287.422353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
13842024-12-21T07:46:43.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 520.797244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
13852024-12-21T07:46:43.600ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13862024-12-21T07:46:43.601ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
13872024-12-21T07:46:43.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 686.514793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
13882024-12-21T07:46:43.754ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7f45ad85-dc4c-400f-af97-79272babed23'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13892024-12-21T07:46:43.754ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
13902024-12-21T07:46:43.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 367.752098ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
13912024-12-21T07:46:43.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 827.625132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
13922024-12-21T07:46:43.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 48.231521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
13932024-12-21T07:46:43.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 139.082326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
13942024-12-21T07:46:44.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.127844919s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
13952024-12-21T07:46:44.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 57.385436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
13962024-12-21T07:46:44.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 164.673356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
13972024-12-21T07:46:44.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 637.027927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
13982024-12-21T07:46:44.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.049804477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
13992024-12-21T07:46:44.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 54.763999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14002024-12-21T07:46:44.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.02914493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
14012024-12-21T07:46:44.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 244.516225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14022024-12-21T07:46:44.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 813.762012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
14032024-12-21T07:46:44.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 392.135725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
14042024-12-21T07:46:44.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.494889305s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
14052024-12-21T07:46:44.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 441.360638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14062024-12-21T07:46:44.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.417811165s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
14072024-12-21T07:46:44.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 755.411683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
14082024-12-21T07:46:44.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 832.274739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
14092024-12-21T07:46:44.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 953.877268ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
14102024-12-21T07:46:44.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 714.491015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
14112024-12-21T07:46:44.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 432.156019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14122024-12-21T07:46:45.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 763.2383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
14132024-12-21T07:46:45.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.259955853s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
14142024-12-21T07:46:45.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 687.500715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
14152024-12-21T07:46:45.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 965.622962ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
14162024-12-21T07:46:45.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 588.840682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14172024-12-21T07:46:45.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.100464909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
14182024-12-21T07:46:45.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 733.359961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
14192024-12-21T07:46:45.486ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14202024-12-21T07:46:45.486ZINFOSledAgent (ServiceManager): Booting oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14212024-12-21T07:46:45.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 928.207399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
14222024-12-21T07:46:45.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 644.283894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
14232024-12-21T07:46:45.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 37.063033ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14242024-12-21T07:46:45.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 55.953367ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14252024-12-21T07:46:45.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 135.634347ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14262024-12-21T07:46:45.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.317026534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
14272024-12-21T07:46:45.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.054142074s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
14282024-12-21T07:46:45.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.139843839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
14292024-12-21T07:46:45.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.378961538s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
14302024-12-21T07:46:45.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 980.387007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14312024-12-21T07:46:46.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 364.341055ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14322024-12-21T07:46:46.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.206385169s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
14332024-12-21T07:46:46.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 817.191496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
14342024-12-21T07:46:46.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 527.380284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
14352024-12-21T07:46:46.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 635.208681ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14362024-12-21T07:46:46.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 973.982045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
14372024-12-21T07:46:46.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 979.855839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
14382024-12-21T07:46:46.518ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53774
14392024-12-21T07:46:46.519ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53774 req_id = 23669d08-f1c1-4200-b9f8-3f80a5a2333d response_code = 200 uri = /baseboard
14402024-12-21T07:46:46.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 535.210006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
14412024-12-21T07:46:46.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 613.872697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
14422024-12-21T07:46:46.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 626.251999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14432024-12-21T07:46:46.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.275053638s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
14442024-12-21T07:46:47.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 565.133399ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14452024-12-21T07:46:47.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.098670827s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
14462024-12-21T07:46:47.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.29798997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
14472024-12-21T07:46:47.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 734.886738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
14482024-12-21T07:46:47.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.149551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
14492024-12-21T07:46:47.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 942.37097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
14502024-12-21T07:46:47.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 529.901954ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
14512024-12-21T07:46:47.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 682.425709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
14522024-12-21T07:46:47.462ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2858b358-7183-451f-b471-559976754305: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c0afcadf-a07f-40ba-ba5d-33030d46dc44'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14532024-12-21T07:46:47.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 727.417964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
14542024-12-21T07:46:47.476ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2858b358-7183-451f-b471-559976754305 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
14552024-12-21T07:46:47.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 930.085862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
14562024-12-21T07:46:47.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 601.181295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14572024-12-21T07:46:47.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 709.778095ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14582024-12-21T07:46:47.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 69.728531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
14592024-12-21T07:46:47.833ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14602024-12-21T07:46:47.833ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
14612024-12-21T07:46:47.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 884.380681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
14622024-12-21T07:46:47.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 81.317965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
14632024-12-21T07:46:47.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 914.385291ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
14642024-12-21T07:46:48.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 173.953368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
14652024-12-21T07:46:48.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 719.994169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
14662024-12-21T07:46:48.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 782.961656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
14672024-12-21T07:46:48.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.183021267s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14682024-12-21T07:46:48.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 924.303004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
14692024-12-21T07:46:48.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 238.477954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
14702024-12-21T07:46:48.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 653.010475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
14712024-12-21T07:46:48.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.356793108s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
14722024-12-21T07:46:48.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 42.027275ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
14732024-12-21T07:46:48.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.065872114s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14742024-12-21T07:46:48.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 56.915221ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
14752024-12-21T07:46:48.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 669.574154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
14762024-12-21T07:46:48.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 975.954899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
14772024-12-21T07:46:48.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 660.749767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
14782024-12-21T07:46:48.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 135.588746ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
14792024-12-21T07:46:48.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 492.846622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
14802024-12-21T07:46:48.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 245.883584ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
14812024-12-21T07:46:48.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 982.653235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
14822024-12-21T07:46:48.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.068872836s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
14832024-12-21T07:46:48.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.322651682s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
14842024-12-21T07:46:48.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.487642345s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
14852024-12-21T07:46:48.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 800.942184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
14862024-12-21T07:46:48.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 535.036238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
14872024-12-21T07:46:49.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.135586092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
14882024-12-21T07:46:49.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 932.979873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
14892024-12-21T07:46:49.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 587.409355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
14902024-12-21T07:46:49.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.288118435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
14912024-12-21T07:46:49.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.358673987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
14922024-12-21T07:46:49.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 537.915333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
14932024-12-21T07:46:49.414ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14942024-12-21T07:46:49.414ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
14952024-12-21T07:46:49.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.072596292s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
14962024-12-21T07:46:49.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 549.939545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
14972024-12-21T07:46:49.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 41.567725ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
14982024-12-21T07:46:49.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.070601455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
14992024-12-21T07:46:49.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 86.359749ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
15002024-12-21T07:46:49.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.043357766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
15012024-12-21T07:46:49.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 515.26154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
15022024-12-21T07:46:49.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 251.483127ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
15032024-12-21T07:46:49.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.413075485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
15042024-12-21T07:46:49.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.449391855s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
15052024-12-21T07:46:49.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.400911458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
15062024-12-21T07:46:50.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 584.194476ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
15072024-12-21T07:46:50.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.083686542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
15082024-12-21T07:46:50.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.38411837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
15092024-12-21T07:46:50.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 514.126779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
15102024-12-21T07:46:50.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 999.254491ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
15112024-12-21T07:46:50.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 856.213302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
15122024-12-21T07:46:50.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.106300088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
15132024-12-21T07:46:50.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.167135116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
15142024-12-21T07:46:50.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 782.605757ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
15152024-12-21T07:46:50.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 429.304897ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
15162024-12-21T07:46:50.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 709.505921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
15172024-12-21T07:46:50.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 739.47803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
15182024-12-21T07:46:50.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.100598274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
15192024-12-21T07:46:50.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.156378661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
15202024-12-21T07:46:51.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 1.172917411s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
15212024-12-21T07:46:51.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.084499458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
15222024-12-21T07:46:51.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.107548748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
15232024-12-21T07:46:51.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 534.531085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
15242024-12-21T07:46:51.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 519.161468ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
15252024-12-21T07:46:51.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.464932405s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
15262024-12-21T07:46:51.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 558.543372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
15272024-12-21T07:46:51.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.066268054s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
15282024-12-21T07:46:51.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.007602419s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
15292024-12-21T07:46:51.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.495851565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
15302024-12-21T07:46:51.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 504.64321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
15312024-12-21T07:46:51.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.47940964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
15322024-12-21T07:46:51.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 776.588845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
15332024-12-21T07:46:51.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 789.556468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
15342024-12-21T07:46:51.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.251641449s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
15352024-12-21T07:46:51.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 674.701426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
15362024-12-21T07:46:51.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.158673519s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
15372024-12-21T07:46:51.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.331099583s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
15382024-12-21T07:46:51.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.145350072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
15392024-12-21T07:46:52.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.072314453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
15402024-12-21T07:46:52.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 966.286709ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
15412024-12-21T07:46:52.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 546.056197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
15422024-12-21T07:46:52.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.366036743s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
15432024-12-21T07:46:52.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.208742971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
15442024-12-21T07:46:52.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 579.689558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
15452024-12-21T07:46:52.510ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15462024-12-21T07:46:52.510ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
15472024-12-21T07:46:52.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 652.803033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
15482024-12-21T07:46:52.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.169216176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
15492024-12-21T07:46:52.559ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15502024-12-21T07:46:52.559ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
15512024-12-21T07:46:52.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 69.92012ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
15522024-12-21T07:46:52.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 27.182657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
15532024-12-21T07:46:52.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 134.534611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
15542024-12-21T07:46:52.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 603.241914ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
15552024-12-21T07:46:52.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 98.833563ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
15562024-12-21T07:46:52.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 979.275131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
15572024-12-21T07:46:52.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 243.984363ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
15582024-12-21T07:46:52.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 239.863666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
15592024-12-21T07:46:52.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 713.734912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
15602024-12-21T07:46:52.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 969.602399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
15612024-12-21T07:46:53.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 875.017907ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
15622024-12-21T07:46:53.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.159495909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
15632024-12-21T07:46:53.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 610.089473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
15642024-12-21T07:46:53.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.019991713s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
15652024-12-21T07:46:53.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 527.399719ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
15662024-12-21T07:46:53.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 243.577694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
15672024-12-21T07:46:53.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.119352009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
15682024-12-21T07:46:53.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 886.892175ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
15692024-12-21T07:46:53.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.29095462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
15702024-12-21T07:46:53.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 716.349021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
15712024-12-21T07:46:53.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.331425937s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
15722024-12-21T07:46:53.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 424.65736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
15732024-12-21T07:46:53.460ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15742024-12-21T07:46:53.460ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
15752024-12-21T07:46:53.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 28.184889ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
15762024-12-21T07:46:53.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 936.59564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
15772024-12-21T07:46:53.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 106.313554ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
15782024-12-21T07:46:53.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 613.826078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
15792024-12-21T07:46:53.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 870.037517ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
15802024-12-21T07:46:53.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.095977085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
15812024-12-21T07:46:53.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.140381782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
15822024-12-21T07:46:53.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 150.17516ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
15832024-12-21T07:46:53.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 835.125985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
15842024-12-21T07:46:53.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 648.464652ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
15852024-12-21T07:46:53.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 580.763036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
15862024-12-21T07:46:53.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.155430666s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
15872024-12-21T07:46:53.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 393.252617ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
15882024-12-21T07:46:53.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.024611854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
15892024-12-21T07:46:54.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 843.034315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
15902024-12-21T07:46:54.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 1.472548143s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
15912024-12-21T07:46:54.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.104692923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
15922024-12-21T07:46:54.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 583.722707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
15932024-12-21T07:46:54.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 625.744275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
15942024-12-21T07:46:54.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.169407908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
15952024-12-21T07:46:54.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.096676218s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
15962024-12-21T07:46:54.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.160024977s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
15972024-12-21T07:46:54.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.323205109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
15982024-12-21T07:46:54.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 522.671552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
15992024-12-21T07:46:54.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.343483785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
16002024-12-21T07:46:54.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 1.358886432s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
16012024-12-21T07:46:54.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 643.483858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
16022024-12-21T07:46:54.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 644.202745ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
16032024-12-21T07:46:54.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.265130424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
16042024-12-21T07:46:54.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 749.076055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
16052024-12-21T07:46:54.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.057933008s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
16062024-12-21T07:46:54.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 563.010459ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
16072024-12-21T07:46:54.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.461358864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
16082024-12-21T07:46:55.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.044579124s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
16092024-12-21T07:46:55.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 640.099149ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
16102024-12-21T07:46:55.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.197238699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
16112024-12-21T07:46:55.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.460821232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
16122024-12-21T07:46:55.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.479142633s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
16132024-12-21T07:46:55.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.373031284s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
16142024-12-21T07:46:55.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 675.106412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
16152024-12-21T07:46:55.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.098279058s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
16162024-12-21T07:46:55.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 754.807975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
16172024-12-21T07:46:55.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 867.654333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
16182024-12-21T07:46:55.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 631.492712ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
16192024-12-21T07:46:55.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 998.675717ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
16202024-12-21T07:46:55.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.34158788s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
16212024-12-21T07:46:55.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 511.27493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
16222024-12-21T07:46:55.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.355889161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
16232024-12-21T07:46:55.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.305630766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
16242024-12-21T07:46:55.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 1.455228834s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
16252024-12-21T07:46:56.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 988.882947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
16262024-12-21T07:46:56.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 814.283538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
16272024-12-21T07:46:56.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.341646839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
16282024-12-21T07:46:56.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 1.122486724s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
16292024-12-21T07:46:56.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 896.959995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
16302024-12-21T07:46:56.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 776.960741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
16312024-12-21T07:46:56.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 920.153156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
16322024-12-21T07:46:56.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 696.488782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
16332024-12-21T07:46:56.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 684.490888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
16342024-12-21T07:46:56.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.191865706s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
16352024-12-21T07:46:56.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.257646678s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
16362024-12-21T07:46:56.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.401675568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
16372024-12-21T07:46:56.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 790.615598ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
16382024-12-21T07:46:56.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 958.222863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
16392024-12-21T07:46:56.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 672.611554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
16402024-12-21T07:46:57.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.159831801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
16412024-12-21T07:46:57.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 906.061288ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
16422024-12-21T07:46:57.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 927.327696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
16432024-12-21T07:46:57.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.362698974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
16442024-12-21T07:46:57.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 863.155388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
16452024-12-21T07:46:57.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 914.880575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
16462024-12-21T07:46:57.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.154121713s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
16472024-12-21T07:46:57.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.116485174s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
16482024-12-21T07:46:57.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.425869801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
16492024-12-21T07:46:57.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 1.267844006s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
16502024-12-21T07:46:57.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 1.441760761s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
16512024-12-21T07:46:57.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 792.520166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
16522024-12-21T07:46:57.518ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16532024-12-21T07:46:57.520ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
16542024-12-21T07:46:57.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 697.519642ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
16552024-12-21T07:46:57.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 597.713594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
16562024-12-21T07:46:57.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 58.298668ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
16572024-12-21T07:46:57.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 71.072987ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
16582024-12-21T07:46:57.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.480496867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
16592024-12-21T07:46:57.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.071357706s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
16602024-12-21T07:46:57.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 134.129012ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
16612024-12-21T07:46:57.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 745.186917ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
16622024-12-21T07:46:57.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 440.74893ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
16632024-12-21T07:46:57.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 770.114194ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
16642024-12-21T07:46:58.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 927.36611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
16652024-12-21T07:46:58.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 721.225517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
16662024-12-21T07:46:58.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.492520768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
16672024-12-21T07:46:58.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.329874658s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
16682024-12-21T07:46:58.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.408450409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
16692024-12-21T07:46:58.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 750.679519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
16702024-12-21T07:46:58.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.30970875s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
16712024-12-21T07:46:58.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.383655869s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
16722024-12-21T07:46:58.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.467367019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
16732024-12-21T07:46:58.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 943.695168ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
16742024-12-21T07:46:58.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.088574226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
16752024-12-21T07:46:58.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.314181162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
16762024-12-21T07:46:58.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 909.153276ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
16772024-12-21T07:46:58.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 833.464493ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
16782024-12-21T07:46:58.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.243204664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
16792024-12-21T07:46:58.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 990.185987ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
16802024-12-21T07:46:58.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.374696282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
16812024-12-21T07:46:58.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.302548271s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
16822024-12-21T07:46:58.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 529.868807ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
16832024-12-21T07:46:58.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.023961331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
16842024-12-21T07:46:58.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.174040867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
16852024-12-21T07:46:59.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.265513285s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
16862024-12-21T07:46:59.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 709.889519ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
16872024-12-21T07:46:59.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 585.147269ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
16882024-12-21T07:46:59.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.460739078s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
16892024-12-21T07:46:59.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.446341555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
16902024-12-21T07:46:59.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.204439335s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
16912024-12-21T07:46:59.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 1.243913965s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
16922024-12-21T07:46:59.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.210976516s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
16932024-12-21T07:46:59.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 563.812428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
16942024-12-21T07:46:59.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.3187063s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
16952024-12-21T07:46:59.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.475351645s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
16962024-12-21T07:46:59.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.231912283s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
16972024-12-21T07:46:59.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 670.735149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
16982024-12-21T07:46:59.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 940.308866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
16992024-12-21T07:46:59.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.348631501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
17002024-12-21T07:47:00.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.130509184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
17012024-12-21T07:47:00.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 854.694313ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
17022024-12-21T07:47:00.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 564.952207ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
17032024-12-21T07:47:00.095ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.662524927s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
17042024-12-21T07:47:00.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.435711716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
17052024-12-21T07:47:00.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 697.681656ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
17062024-12-21T07:47:00.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.405448556s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
17072024-12-21T07:47:00.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.392960052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
17082024-12-21T07:47:00.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 930.059674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
17092024-12-21T07:47:00.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 970.401031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
17102024-12-21T07:47:00.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 1.286686405s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
17112024-12-21T07:47:00.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.073742336s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
17122024-12-21T07:47:00.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 727.422757ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
17132024-12-21T07:47:00.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 938.237029ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
17142024-12-21T07:47:00.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.380381033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
17152024-12-21T07:47:00.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.458468805s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
17162024-12-21T07:47:00.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 875.107747ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
17172024-12-21T07:47:00.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.062068792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
17182024-12-21T07:47:00.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.110422198s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
17192024-12-21T07:47:00.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.432685906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
17202024-12-21T07:47:01.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.368858539s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
17212024-12-21T07:47:01.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 907.097449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
17222024-12-21T07:47:01.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.488795917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
17232024-12-21T07:47:01.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 734.24598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
17242024-12-21T07:47:01.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 952.137358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
17252024-12-21T07:47:01.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 863.614019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
17262024-12-21T07:47:01.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 1.230884448s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
17272024-12-21T07:47:01.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 880.540047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
17282024-12-21T07:47:01.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.221037483s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
17292024-12-21T07:47:01.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.068499739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
17302024-12-21T07:47:01.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 990.385142ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
17312024-12-21T07:47:01.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.231502581s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
17322024-12-21T07:47:01.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 689.904997ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
17332024-12-21T07:47:01.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 1.475814928s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
17342024-12-21T07:47:02.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 812.774366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
17352024-12-21T07:47:02.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.030061991s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
17362024-12-21T07:47:02.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 758.051938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
17372024-12-21T07:47:02.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.22793827s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
17382024-12-21T07:47:02.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.264524292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
17392024-12-21T07:47:02.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.379056966s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
17402024-12-21T07:47:02.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.416096341s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
17412024-12-21T07:47:02.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 532.069068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
17422024-12-21T07:47:02.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.196108183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
17432024-12-21T07:47:02.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.49892663s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
17442024-12-21T07:47:02.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 872.606275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
17452024-12-21T07:47:02.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.215021988s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
17462024-12-21T07:47:02.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.050715926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
17472024-12-21T07:47:02.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 699.869051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
17482024-12-21T07:47:02.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 838.259784ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
17492024-12-21T07:47:02.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 935.521676ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
17502024-12-21T07:47:02.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 865.063975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
17512024-12-21T07:47:02.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 693.597975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
17522024-12-21T07:47:02.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 668.399522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
17532024-12-21T07:47:02.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 549.624196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
17542024-12-21T07:47:03.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.379821515s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
17552024-12-21T07:47:03.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.445756532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
17562024-12-21T07:47:03.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 606.990602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
17572024-12-21T07:47:03.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 581.838419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
17582024-12-21T07:47:03.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 641.831607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
17592024-12-21T07:47:03.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 1.181423751s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
17602024-12-21T07:47:03.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 566.895568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
17612024-12-21T07:47:03.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 594.332212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
17622024-12-21T07:47:03.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.235324176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
17632024-12-21T07:47:03.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.361788816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
17642024-12-21T07:47:03.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 990.083229ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
17652024-12-21T07:47:03.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 850.394935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
17662024-12-21T07:47:03.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.479710792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
17672024-12-21T07:47:03.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 713.032463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
17682024-12-21T07:47:03.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 576.401496ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
17692024-12-21T07:47:03.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 836.980579ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
17702024-12-21T07:47:03.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.41660699s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
17712024-12-21T07:47:03.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.206596145s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
17722024-12-21T07:47:03.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 951.567753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
17732024-12-21T07:47:03.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.397134729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
17742024-12-21T07:47:03.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.316500894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
17752024-12-21T07:47:04.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 619.662019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
17762024-12-21T07:47:04.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.474337467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
17772024-12-21T07:47:04.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 927.35435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
17782024-12-21T07:47:04.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.331004893s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
17792024-12-21T07:47:04.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 818.433761ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
17802024-12-21T07:47:04.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.08775874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
17812024-12-21T07:47:04.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 523.020879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
17822024-12-21T07:47:04.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 957.304642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
17832024-12-21T07:47:04.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 786.52585ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
17842024-12-21T07:47:04.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 1.007549743s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
17852024-12-21T07:47:04.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 829.688449ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
17862024-12-21T07:47:04.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.171423299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
17872024-12-21T07:47:04.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 797.889853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
17882024-12-21T07:47:04.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 930.609551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
17892024-12-21T07:47:04.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 760.695176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
17902024-12-21T07:47:05.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.016942152s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
17912024-12-21T07:47:05.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.118931834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
17922024-12-21T07:47:05.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.127469092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
17932024-12-21T07:47:05.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.369224508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
17942024-12-21T07:47:05.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.023767379s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
17952024-12-21T07:47:05.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 514.518905ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
17962024-12-21T07:47:05.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.224073234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
17972024-12-21T07:47:05.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 710.923101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
17982024-12-21T07:47:05.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 542.834244ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
17992024-12-21T07:47:05.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 1.134420131s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
18002024-12-21T07:47:05.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.082495239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
18012024-12-21T07:47:05.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.121001097s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
18022024-12-21T07:47:05.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.385711967s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
18032024-12-21T07:47:05.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 712.818502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
18042024-12-21T07:47:05.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 926.704668ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
18052024-12-21T07:47:05.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.474533933s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
18062024-12-21T07:47:05.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 970.476571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
18072024-12-21T07:47:05.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.379757951s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
18082024-12-21T07:47:05.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 900.800937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
18092024-12-21T07:47:05.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 668.016092ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
18102024-12-21T07:47:05.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 806.707564ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
18112024-12-21T07:47:06.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.437976152s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
18122024-12-21T07:47:06.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.351235351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
18132024-12-21T07:47:06.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 534.324227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
18142024-12-21T07:47:06.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 969.180182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
18152024-12-21T07:47:06.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.046614256s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
18162024-12-21T07:47:06.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.242431755s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
18172024-12-21T07:47:06.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 802.833075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
18182024-12-21T07:47:06.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 510.157684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
18192024-12-21T07:47:06.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.151598082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
18202024-12-21T07:47:06.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 703.197864ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
18212024-12-21T07:47:06.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.454542916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
18222024-12-21T07:47:06.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 1.482006237s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
18232024-12-21T07:47:06.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 778.547129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
18242024-12-21T07:47:06.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 564.205329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
18252024-12-21T07:47:06.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 958.298404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
18262024-12-21T07:47:06.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.114588294s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
18272024-12-21T07:47:06.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 545.5158ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
18282024-12-21T07:47:06.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 815.041118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
18292024-12-21T07:47:07.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 668.547994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
18302024-12-21T07:47:07.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 998.444473ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
18312024-12-21T07:47:07.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.019824671s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
18322024-12-21T07:47:07.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 692.277905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
18332024-12-21T07:47:07.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.492244887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
18342024-12-21T07:47:07.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.294865759s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
18352024-12-21T07:47:07.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 973.328848ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
18362024-12-21T07:47:07.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 835.194697ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
18372024-12-21T07:47:07.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.198892045s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
18382024-12-21T07:47:07.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 659.967311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
18392024-12-21T07:47:07.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 789.359558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
18402024-12-21T07:47:07.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.111056761s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
18412024-12-21T07:47:07.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.143847425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
18422024-12-21T07:47:07.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.00127751s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
18432024-12-21T07:47:07.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.301065107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
18442024-12-21T07:47:07.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 633.967076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
18452024-12-21T07:47:07.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.09258559s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
18462024-12-21T07:47:07.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 713.107942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
18472024-12-21T07:47:07.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.444088878s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
18482024-12-21T07:47:08.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.011404423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
18492024-12-21T07:47:08.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 518.747313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
18502024-12-21T07:47:08.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 686.829007ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
18512024-12-21T07:47:08.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 687.778188ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
18522024-12-21T07:47:08.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 1.123103835s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
18532024-12-21T07:47:08.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 596.525271ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
18542024-12-21T07:47:08.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 982.919942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
18552024-12-21T07:47:08.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 944.339177ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
18562024-12-21T07:47:08.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 738.326756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
18572024-12-21T07:47:08.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 903.516477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
18582024-12-21T07:47:08.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.037995178s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
18592024-12-21T07:47:08.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.021825243s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
18602024-12-21T07:47:08.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.297890294s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
18612024-12-21T07:47:08.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 981.289997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
18622024-12-21T07:47:08.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 1.437600969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
18632024-12-21T07:47:08.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.074005615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
18642024-12-21T07:47:08.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 538.723438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
18652024-12-21T07:47:08.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.297217878s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
18662024-12-21T07:47:08.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 1.125065922s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
18672024-12-21T07:47:08.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.037885197s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
18682024-12-21T07:47:08.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 826.495705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
18692024-12-21T07:47:09.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 583.084884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
18702024-12-21T07:47:09.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 809.509992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
18712024-12-21T07:47:09.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.461757516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
18722024-12-21T07:47:09.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 1.146805478s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
18732024-12-21T07:47:09.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.197302299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
18742024-12-21T07:47:09.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 1.103708893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
18752024-12-21T07:47:09.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 576.669011ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
18762024-12-21T07:47:09.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 589.244455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
18772024-12-21T07:47:09.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 531.406442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
18782024-12-21T07:47:09.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 559.78665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
18792024-12-21T07:47:09.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 523.842459ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
18802024-12-21T07:47:09.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.40552356s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
18812024-12-21T07:47:09.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.410809861s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
18822024-12-21T07:47:09.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 523.406582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
18832024-12-21T07:47:09.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 935.847856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
18842024-12-21T07:47:09.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 900.430283ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
18852024-12-21T07:47:09.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 838.707815ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
18862024-12-21T07:47:09.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 566.779008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
18872024-12-21T07:47:09.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 765.224421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
18882024-12-21T07:47:10.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 880.53146ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
18892024-12-21T07:47:10.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.400051702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
18902024-12-21T07:47:10.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 611.40172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
18912024-12-21T07:47:10.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.056280885s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
18922024-12-21T07:47:10.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 556.752622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
18932024-12-21T07:47:10.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 896.452548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
18942024-12-21T07:47:10.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 801.497539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
18952024-12-21T07:47:10.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 958.925158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
18962024-12-21T07:47:10.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 979.496837ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
18972024-12-21T07:47:10.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 734.683405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
18982024-12-21T07:47:10.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.019559079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
18992024-12-21T07:47:10.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.437064682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
19002024-12-21T07:47:10.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.177110057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
19012024-12-21T07:47:10.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 1.082304974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
19022024-12-21T07:47:10.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 899.825995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
19032024-12-21T07:47:10.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 871.180835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
19042024-12-21T07:47:10.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 1.474021733s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
19052024-12-21T07:47:10.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 1.490870075s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
19062024-12-21T07:47:10.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 1.101488814s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
19072024-12-21T07:47:10.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 757.045967ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
19082024-12-21T07:47:11.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 514.599651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
19092024-12-21T07:47:11.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.301581193s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
19102024-12-21T07:47:11.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8") failed: Property not found. retry in 1.325404667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
19112024-12-21T07:47:11.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e") failed: Property not found. retry in 1.355545568s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
19122024-12-21T07:47:11.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e") failed: Property not found. retry in 900.125496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
19132024-12-21T07:47:11.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 518.871236ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
19142024-12-21T07:47:11.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.041740526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
19152024-12-21T07:47:11.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 1.436403794s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
19162024-12-21T07:47:11.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 882.939312ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
19172024-12-21T07:47:11.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2858b358-7183-451f-b471-559976754305") failed: Property not found. retry in 1.3978382s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
19182024-12-21T07:47:11.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.103771062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
19192024-12-21T07:47:11.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 1.183446312s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
19202024-12-21T07:47:11.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 632.35315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
19212024-12-21T07:47:11.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 1.46220627s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
19222024-12-21T07:47:11.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd") failed: Property not found. retry in 1.451391759s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
19232024-12-21T07:47:11.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 525.110614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
19242024-12-21T07:47:11.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490") failed: Property not found. retry in 1.189452757s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
19252024-12-21T07:47:11.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434") failed: Property not found. retry in 943.687574ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
19262024-12-21T07:47:11.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8") failed: Property not found. retry in 1.105137549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
19272024-12-21T07:47:12.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571") failed: Property not found. retry in 746.311608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
19282024-12-21T07:47:12.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab") failed: Property not found. retry in 557.036903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
19292024-12-21T07:47:12.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981") failed: Property not found. retry in 1.287171768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
19302024-12-21T07:47:12.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e") failed: Property not found. retry in 632.427634ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
19312024-12-21T07:47:12.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8") failed: Property not found. retry in 1.478378889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
19322024-12-21T07:47:12.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6") failed: Property not found. retry in 671.661212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
19332024-12-21T07:47:12.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35") failed: Property not found. retry in 1.220572782s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
19342024-12-21T07:47:12.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912") failed: Property not found. retry in 1.373818872s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
19352024-12-21T07:47:12.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f") failed: Property not found. retry in 931.643553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
19362024-12-21T07:47:12.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7") failed: Property not found. retry in 986.805647ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
19372024-12-21T07:47:13.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 826.153024ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
19382024-12-21T07:47:13.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468") failed: Property not found. retry in 604.710958ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
19392024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_d20dc299-451b-4507-a4d3-397fc1c3b571
19402024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_4b205886-0970-4a9e-bff0-ae1192504434
19412024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_03b723f9-dc36-4197-af85-09d96793295e
19422024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_0d887b58-d2d3-498a-b734-4ce0aa0e52d6
19432024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_428cd3f9-eecf-4305-9c0b-1698df6403fd
19442024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_cd9693cc-b2a2-4b9b-beee-fc2908a9238e
19452024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_6eaeb9f0-f302-479e-96a2-0b6de3fd3912
19462024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_2d3ccbc9-9eb4-4e83-8f62-2b3a550843ab
19472024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_1595c632-cfae-4f6b-937d-d413dd8cf0b7
19482024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_81201a68-4f2b-422c-8aca-1b05de438ba8
19492024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_c46fcdda-0c08-4172-b4f8-02e5f76bd6d8
19502024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_35eb2ffd-7287-4600-9dc9-0915d4b9d981
19512024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_a7fd0ff0-5ae3-4ea4-83e5-492b795a529f
19522024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_2858b358-7183-451f-b471-559976754305
19532024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_85673d8a-2e64-480d-8b22-5ecb66c02468
19542024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_e6b54c38-8771-4091-8fc3-2bbdae94bd35
19552024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_fd135bfe-4bd2-40b6-8ecc-ddea8fcbabf8
19562024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_cfa42fd9-c7b7-49ce-9606-f6ff6f004490
19572024-12-21T07:47:14.640ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_8fbd6070-9acd-409b-bda8-dadf2a05b00e
19582024-12-21T07:47:14.641ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
19592024-12-21T07:47:14.643ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
19602024-12-21T07:47:14.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41548477 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40288 req_id = 926e6d8c-c778-4989-9b49-f1f7bfc1dc13 response_code = 204 uri = /omicron-zones
19612024-12-21T07:47:14.661ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
19622024-12-21T07:47:14.927ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
19632024-12-21T07:47:14.929ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:802
19642024-12-21T07:47:14.974ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
19652024-12-21T07:47:16.565ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44885
19662024-12-21T07:47:16.566ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44885 req_id = 4e16b624-928c-4818-9486-202b480f4114 response_code = 200 uri = /baseboard
19672024-12-21T07:47:18.079ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19682024-12-21T07:47:18.095ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
19692024-12-21T07:47:18.095ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/nexus.rs:527 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
19702024-12-21T07:47:18.273ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19712024-12-21T07:47:18.363ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19722024-12-21T07:47:18.545ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19732024-12-21T07:47:18.653ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19742024-12-21T07:47:18.796ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19752024-12-21T07:47:19.105ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
19762024-12-21T07:47:19.133ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19772024-12-21T07:47:19.178ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/nexus.rs:527 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
19782024-12-21T07:47:19.551ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19792024-12-21T07:47:19.696ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 34.490811036s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
19802024-12-21T07:47:19.776ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19812024-12-21T07:47:20.107ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e) file = sled-agent/src/probe_manager.rs:231 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
19822024-12-21T07:47:20.175ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19832024-12-21T07:47:20.738ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19842024-12-21T07:47:21.259ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19852024-12-21T07:47:22.795ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5c920a48-0134-4819-a399-3a498cdeb4d4", "content-length": "173", "date": "Sat, 21 Dec 2024 07:47:22 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"5b228607-94ff-4bfc-99d8-b10385e90443\"", request_id: "5c920a48-0134-4819-a399-3a498cdeb4d4" } file = sled-agent/src/rack_setup/service.rs:1078
19862024-12-21T07:47:23.299ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
19872024-12-21T07:47:23.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37418
19882024-12-21T07:47:23.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1359 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37418 req_id = 405813f2-1bc5-4ee5-93d4-0523f3136d0c response_code = 200 uri = /vpc-routes
19892024-12-21T07:47:23.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59022
19902024-12-21T07:47:23.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59022 req_id = 7631194f-d1b1-49e5-a8d9-b577d4135f71 response_code = 200 uri = /vpc-routes
19912024-12-21T07:47:23.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45200
19922024-12-21T07:47:23.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45200 req_id = 58465218-da24-4e03-9bc3-22494efa4e7a response_code = 200 uri = /vpc-routes
19932024-12-21T07:47:23.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40287
19942024-12-21T07:47:23.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19952024-12-21T07:47:23.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19962024-12-21T07:47:23.974ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
19972024-12-21T07:47:23.975ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
19982024-12-21T07:47:23.989ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19992024-12-21T07:47:23.989ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff
20002024-12-21T07:47:23.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56305
20012024-12-21T07:47:24.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
20022024-12-21T07:47:24.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37418 req_id = 6e2a79fd-9544-47ba-8fe2-6c58bd9875ee response_code = 204 uri = /eip-gateways
20032024-12-21T07:47:24.006ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20042024-12-21T07:47:24.006ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20052024-12-21T07:47:24.006ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
20062024-12-21T07:47:24.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52645
20072024-12-21T07:47:24.012ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
20082024-12-21T07:47:24.012ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20092024-12-21T07:47:24.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
20102024-12-21T07:47:24.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45200 req_id = 77449fe2-223b-489f-ac02-38189e06e373 response_code = 204 uri = /eip-gateways
20112024-12-21T07:47:24.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
20122024-12-21T07:47:24.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59022 req_id = 83a273fb-26c1-41c2-bd52-43c6fff0583d response_code = 204 uri = /eip-gateways
20132024-12-21T07:47:24.021ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20142024-12-21T07:47:24.021ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac
20152024-12-21T07:47:24.038ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20162024-12-21T07:47:24.038ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff
20172024-12-21T07:47:24.054ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20182024-12-21T07:47:24.055ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
20192024-12-21T07:47:24.064ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
20202024-12-21T07:47:24.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20212024-12-21T07:47:24.069ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac
20222024-12-21T07:47:24.084ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20232024-12-21T07:47:24.084ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240
20242024-12-21T07:47:24.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49958
20252024-12-21T07:47:24.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49958 req_id = 19010937-bafc-43f3-8ce0-b5dbc5ddf079 response_code = 200 uri = /v2p
20262024-12-21T07:47:24.100ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20272024-12-21T07:47:24.100ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff
20282024-12-21T07:47:24.119ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20292024-12-21T07:47:24.119ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240
20302024-12-21T07:47:24.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40482
20312024-12-21T07:47:24.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40482 req_id = b20204ea-c0c1-40f5-809c-7cd3f8d9738f response_code = 200 uri = /v2p
20322024-12-21T07:47:24.141ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20332024-12-21T07:47:24.141ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac
20342024-12-21T07:47:24.157ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20352024-12-21T07:47:24.157ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd7c5ec-686c-4ecd-8837-505154304410
20362024-12-21T07:47:24.172ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20372024-12-21T07:47:24.172ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd7c5ec-686c-4ecd-8837-505154304410
20382024-12-21T07:47:24.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11085 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59022 req_id = ac768b8e-15b4-42ec-afaa-340eec4bebb8 response_code = 204 uri = /vpc-routes
20392024-12-21T07:47:24.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62671
20402024-12-21T07:47:24.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62671 req_id = d9294598-d2ad-43bc-bec3-39a39f9e836c response_code = 200 uri = /v2p
20412024-12-21T07:47:24.190ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20422024-12-21T07:47:24.191ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240
20432024-12-21T07:47:24.207ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20442024-12-21T07:47:24.207ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7
20452024-12-21T07:47:24.225ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20462024-12-21T07:47:24.225ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7
20472024-12-21T07:47:24.243ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20482024-12-21T07:47:24.243ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd7c5ec-686c-4ecd-8837-505154304410
20492024-12-21T07:47:24.258ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20502024-12-21T07:47:24.258ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e
20512024-12-21T07:47:24.262ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
20522024-12-21T07:47:24.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37418 req_id = 56bdbbbd-be12-4e9b-8740-79f894b947be response_code = 204 uri = /vpc-routes
20532024-12-21T07:47:24.271ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20542024-12-21T07:47:24.271ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e
20552024-12-21T07:47:24.288ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20562024-12-21T07:47:24.288ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7
20572024-12-21T07:47:24.297ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
20582024-12-21T07:47:24.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9087 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45200 req_id = 312a4968-bfb4-4f8b-889c-44a4e3fdcc2a response_code = 204 uri = /vpc-routes
20592024-12-21T07:47:24.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20602024-12-21T07:47:24.307ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d75297c3-49da-487f-a95f-88dc2681ce54
20612024-12-21T07:47:24.320ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20622024-12-21T07:47:24.320ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d75297c3-49da-487f-a95f-88dc2681ce54
20632024-12-21T07:47:24.336ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20642024-12-21T07:47:24.336ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e
20652024-12-21T07:47:24.353ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20662024-12-21T07:47:24.353ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798
20672024-12-21T07:47:24.364ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20682024-12-21T07:47:24.364ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798
20692024-12-21T07:47:24.378ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20702024-12-21T07:47:24.379ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d75297c3-49da-487f-a95f-88dc2681ce54
20712024-12-21T07:47:24.392ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20722024-12-21T07:47:24.392ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64
20732024-12-21T07:47:24.403ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20742024-12-21T07:47:24.403ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64
20752024-12-21T07:47:24.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 443590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40287 req_id = bd305ba5-5008-4689-b0d0-96590d3ed104 response_code = 200 uri = /inventory
20762024-12-21T07:47:24.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 418849 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56305 req_id = b2bab825-be26-4f9e-9203-9a451b3bb590 response_code = 200 uri = /inventory
20772024-12-21T07:47:24.417ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20782024-12-21T07:47:24.417ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798
20792024-12-21T07:47:24.439ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20802024-12-21T07:47:24.439ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64
20812024-12-21T07:47:24.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52645 req_id = 5bfa2489-4a78-42fa-a323-cf8b4151d9e1 response_code = 200 uri = /inventory
20822024-12-21T07:47:25.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64248
20832024-12-21T07:47:25.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20842024-12-21T07:47:25.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20852024-12-21T07:47:25.407ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
20862024-12-21T07:47:25.407ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
20872024-12-21T07:47:25.419ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20882024-12-21T07:47:25.419ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff
20892024-12-21T07:47:25.444ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20902024-12-21T07:47:25.444ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac
20912024-12-21T07:47:25.468ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20922024-12-21T07:47:25.468ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240
20932024-12-21T07:47:25.490ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20942024-12-21T07:47:25.490ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd7c5ec-686c-4ecd-8837-505154304410
20952024-12-21T07:47:25.512ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20962024-12-21T07:47:25.512ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7
20972024-12-21T07:47:25.535ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20982024-12-21T07:47:25.535ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e
20992024-12-21T07:47:25.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59107
21002024-12-21T07:47:25.550ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21012024-12-21T07:47:25.550ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21022024-12-21T07:47:25.550ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21032024-12-21T07:47:25.550ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21042024-12-21T07:47:25.550ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21052024-12-21T07:47:25.550ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21062024-12-21T07:47:25.550ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21072024-12-21T07:47:25.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59107 req_id = 51262307-bda7-497b-bca3-4303a2ce34a5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21082024-12-21T07:47:25.552ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
21092024-12-21T07:47:25.556ZINFOSledAgent (RSS): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
21102024-12-21T07:47:25.556ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21112024-12-21T07:47:25.556ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d75297c3-49da-487f-a95f-88dc2681ce54
21122024-12-21T07:47:25.560ZINFOSledAgent (RSS): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
21132024-12-21T07:47:25.580ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21142024-12-21T07:47:25.580ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798
21152024-12-21T07:47:25.602ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21162024-12-21T07:47:25.602ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64
21172024-12-21T07:47:25.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64248 req_id = a67649d6-9094-4876-b1be-dbae2802e91a response_code = 200 uri = /inventory
21182024-12-21T07:47:25.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59871
21192024-12-21T07:47:25.654ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21202024-12-21T07:47:25.654ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21212024-12-21T07:47:25.654ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
21222024-12-21T07:47:25.654ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
21232024-12-21T07:47:25.667ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21242024-12-21T07:47:25.667ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff
21252024-12-21T07:47:25.695ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21262024-12-21T07:47:25.695ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac
21272024-12-21T07:47:25.720ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21282024-12-21T07:47:25.720ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240
21292024-12-21T07:47:25.748ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21302024-12-21T07:47:25.748ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd7c5ec-686c-4ecd-8837-505154304410
21312024-12-21T07:47:25.773ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21322024-12-21T07:47:25.773ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7
21332024-12-21T07:47:25.800ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21342024-12-21T07:47:25.800ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e
21352024-12-21T07:47:25.824ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21362024-12-21T07:47:25.824ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d75297c3-49da-487f-a95f-88dc2681ce54
21372024-12-21T07:47:25.847ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21382024-12-21T07:47:25.848ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798
21392024-12-21T07:47:25.869ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21402024-12-21T07:47:25.869ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64
21412024-12-21T07:47:25.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59871 req_id = be346e0d-6c51-46f1-9339-b1a8f30d11e1 response_code = 200 uri = /inventory
21422024-12-21T07:47:26.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55679
21432024-12-21T07:47:26.131ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21442024-12-21T07:47:26.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21452024-12-21T07:47:26.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21462024-12-21T07:47:26.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21472024-12-21T07:47:26.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21482024-12-21T07:47:26.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21492024-12-21T07:47:26.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21502024-12-21T07:47:26.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55679 req_id = a9d6af3b-0455-4212-926c-9e4a7b6136fc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21512024-12-21T07:47:26.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55367
21522024-12-21T07:47:26.135ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21532024-12-21T07:47:26.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21542024-12-21T07:47:26.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21552024-12-21T07:47:26.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21562024-12-21T07:47:26.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21572024-12-21T07:47:26.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21582024-12-21T07:47:26.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21592024-12-21T07:47:26.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55367 req_id = c67ab3a8-9550-4a4f-8df7-065f1434aec1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21602024-12-21T07:47:26.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59985
21612024-12-21T07:47:26.952ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21622024-12-21T07:47:26.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21632024-12-21T07:47:26.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21642024-12-21T07:47:26.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21652024-12-21T07:47:26.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21662024-12-21T07:47:26.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21672024-12-21T07:47:26.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21682024-12-21T07:47:26.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59985 req_id = f1cb0fa8-e56c-4b43-90d9-335e5fd26932 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21692024-12-21T07:47:32.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51695
21702024-12-21T07:47:32.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51695 req_id = bf450083-e856-40cd-b98e-2ed34dd07575 response_code = 200 uri = /vpc-routes
21712024-12-21T07:47:33.022ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
21722024-12-21T07:47:33.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51695 req_id = c1e28aea-7666-419c-a66a-7fef5e034c44 response_code = 204 uri = /eip-gateways
21732024-12-21T07:47:33.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51695 req_id = 4e1f1d04-ee3b-4953-bebe-bd925b71e063 response_code = 204 uri = /vpc-routes
21742024-12-21T07:47:46.608ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36176
21752024-12-21T07:47:46.609ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36176 req_id = 7af778d5-bf2c-4b24-baab-94142f96f4d2 response_code = 200 uri = /baseboard
21762024-12-21T07:47:53.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49620
21772024-12-21T07:47:53.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49620 req_id = 847ec9f3-c1dc-4220-87f2-ccf9be66cae4 response_code = 200 uri = /vpc-routes
21782024-12-21T07:47:53.761ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
21792024-12-21T07:47:53.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49620 req_id = ce803a45-a790-4b14-97b9-d53ce47271b9 response_code = 204 uri = /eip-gateways
21802024-12-21T07:47:53.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49620 req_id = 0a47398e-e5a0-4d74-a4fb-41dbef607ffe response_code = 204 uri = /vpc-routes
21812024-12-21T07:47:53.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33794
21822024-12-21T07:47:53.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33794 req_id = 3a9d4843-f2c9-457e-a4f2-0f0d9c3650d5 response_code = 200 uri = /vpc-routes
21832024-12-21T07:47:53.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58601
21842024-12-21T07:47:53.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58601 req_id = a5744a4f-906b-43ce-adc8-5ac438f6e710 response_code = 200 uri = /vpc-routes
21852024-12-21T07:47:53.826ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
21862024-12-21T07:47:53.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33794 req_id = 47bfffb2-32bf-402c-b54f-a5e0ace061e5 response_code = 204 uri = /eip-gateways
21872024-12-21T07:47:53.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45345
21882024-12-21T07:47:53.843ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21892024-12-21T07:47:53.923ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21902024-12-21T07:47:53.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148060 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45345 req_id = 30cba436-29b5-46dd-81eb-ed9635ec2599 response_code = 204 uri = /switch-ports
21912024-12-21T07:47:53.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44069
21922024-12-21T07:47:53.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46186
21932024-12-21T07:47:53.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63430
21942024-12-21T07:47:53.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53020
21952024-12-21T07:47:53.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
21962024-12-21T07:47:53.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58601 req_id = da8e78b5-f15c-4532-9a54-a1f220ba3306 response_code = 204 uri = /eip-gateways
21972024-12-21T07:47:53.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21982024-12-21T07:47:53.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33794 req_id = 427ab1bf-8e31-44b4-ba53-4e5b2ef34694 response_code = 204 uri = /vpc-routes
21992024-12-21T07:47:53.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60250
22002024-12-21T07:47:54.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5506 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44069 req_id = e070c4f1-b97b-4071-a31e-bd9da448f05c response_code = 200 uri = /v2p
22012024-12-21T07:47:54.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10025 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45345 req_id = 7d5a36e4-defb-42fa-8b84-55a3e1f67c47 response_code = 200 uri = /network-bootstore-config
22022024-12-21T07:47:54.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60250 req_id = 9a6c6d50-563e-436b-9a8b-42ca95e27ade response_code = 200 uri = /v2p
22032024-12-21T07:47:54.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63430 req_id = cf2fea43-a988-471b-8de2-238dd9f54903 response_code = 200 uri = /v2p
22042024-12-21T07:47:54.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 472 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58601 req_id = 80d9cca2-07a4-4373-bd8e-bddbf01e3d9e response_code = 204 uri = /vpc-routes
22052024-12-21T07:47:54.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22062024-12-21T07:47:54.042ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
22072024-12-21T07:47:54.042ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
22082024-12-21T07:47:54.043ZINFOSledAgent (bootstore): Writing ledger to /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
22092024-12-21T07:47:54.044ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
22102024-12-21T07:47:54.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2932 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45345 req_id = 6736795b-73bd-4f48-ae49-94bc1021e8ca response_code = 204 uri = /network-bootstore-config
22112024-12-21T07:47:54.099ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22122024-12-21T07:47:54.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46186 req_id = 3eebcafa-ea0c-40f0-937a-803627758150 response_code = 204 uri = /switch-ports
22132024-12-21T07:47:54.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46186 req_id = d09d4e5c-b398-470d-9e34-805af16a0dbc response_code = 200 uri = /network-bootstore-config
22142024-12-21T07:47:54.137ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22152024-12-21T07:47:54.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195150 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53020 req_id = f909c238-6572-48b9-b6ca-d3dd48dea90f response_code = 204 uri = /switch-ports
22162024-12-21T07:47:54.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53020 req_id = b4211ba4-d88c-442b-b08a-757d47f052c6 response_code = 200 uri = /network-bootstore-config
22172024-12-21T07:48:16.640ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55051
22182024-12-21T07:48:16.640ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55051 req_id = 84096338-6c47-4c83-93e0-3273aa1f0657 response_code = 200 uri = /baseboard
22192024-12-21T07:48:23.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60932
22202024-12-21T07:48:23.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60932 req_id = bf42dfb1-9e52-4fa9-a3c2-c67a17f362ff response_code = 200 uri = /vpc-routes
22212024-12-21T07:48:23.741ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
22222024-12-21T07:48:23.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60932 req_id = 4ec29849-5afc-4fa5-8628-b1ab9215e000 response_code = 204 uri = /eip-gateways
22232024-12-21T07:48:23.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60932 req_id = b47f2fd0-b4b0-4b9d-8453-f36218a6425e response_code = 204 uri = /vpc-routes
22242024-12-21T07:48:23.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48651
22252024-12-21T07:48:23.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48651 req_id = 5b7965fa-2b0b-4f4e-9cf9-f76d2f81fc63 response_code = 200 uri = /vpc-routes
22262024-12-21T07:48:23.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41590
22272024-12-21T07:48:23.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41590 req_id = c1b2b5c1-2687-4952-9d10-28cafdde0bb6 response_code = 200 uri = /vpc-routes
22282024-12-21T07:48:23.931ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
22292024-12-21T07:48:23.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48651 req_id = 72a59a65-cf4f-45a4-a02e-4ba04059e5a4 response_code = 204 uri = /eip-gateways
22302024-12-21T07:48:23.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48651 req_id = c3ee4a3c-8630-448d-b1ca-1a1ffb6f044e response_code = 204 uri = /vpc-routes
22312024-12-21T07:48:23.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
22322024-12-21T07:48:23.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41590 req_id = 120bf959-442e-44bd-9198-1f86911825e2 response_code = 204 uri = /eip-gateways
22332024-12-21T07:48:23.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34965
22342024-12-21T07:48:23.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34965 req_id = 986e95e2-246e-4e6b-964c-f18674174426 response_code = 200 uri = /v2p
22352024-12-21T07:48:23.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41590 req_id = 1f79402a-4a68-4b61-972d-54b60f6302f0 response_code = 204 uri = /vpc-routes
22362024-12-21T07:48:23.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33121
22372024-12-21T07:48:23.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33121 req_id = 9da3df8e-5fd7-4bd8-a51e-304cd54bdcd4 response_code = 200 uri = /v2p
22382024-12-21T07:48:23.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60795
22392024-12-21T07:48:23.986ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22402024-12-21T07:48:24.032ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22412024-12-21T07:48:24.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60795 req_id = 9afef3e1-0d55-49ad-b276-6dbfb31add3f response_code = 204 uri = /switch-ports
22422024-12-21T07:48:24.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59272
22432024-12-21T07:48:24.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52785
22442024-12-21T07:48:24.102ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22452024-12-21T07:48:24.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60795 req_id = 068b6c88-2454-4fa8-84a6-21bd2ce26641 response_code = 200 uri = /network-bootstore-config
22462024-12-21T07:48:24.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4567 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52785 req_id = 483aa347-fccf-442c-9122-1bddcd45edda response_code = 200 uri = /v2p
22472024-12-21T07:48:24.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57553
22482024-12-21T07:48:24.142ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22492024-12-21T07:48:24.203ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22502024-12-21T07:48:24.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100717 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59272 req_id = 4c57c6a2-2f0c-40b9-8cca-b4a006143d81 response_code = 204 uri = /switch-ports
22512024-12-21T07:48:24.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59272 req_id = cb99efd8-bbe5-4c9d-b0f5-a190eb00418e response_code = 200 uri = /network-bootstore-config
22522024-12-21T07:48:24.239ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22532024-12-21T07:48:24.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57553 req_id = f7fe5650-09b8-43c2-8c00-c50ceba4f85b response_code = 204 uri = /switch-ports
22542024-12-21T07:48:24.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57553 req_id = f911f995-22a4-4ce8-acd8-6c731c311945 response_code = 200 uri = /network-bootstore-config
22552024-12-21T07:48:35.894ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:55605 remote_addr = [fd00:1122:3344:101::d]:37210 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
22562024-12-21T07:48:35.926ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30534 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 697467fc-83a3-4f67-939c-3ea10f7540e5 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
22572024-12-21T07:48:46.682ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48724
22582024-12-21T07:48:46.682ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48724 req_id = 13dea6ae-dacf-482c-a5b2-48d4d43d143e response_code = 200 uri = /baseboard
22592024-12-21T07:48:53.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33222
22602024-12-21T07:48:53.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33222 req_id = 39c2e9c7-872d-4aad-8d47-ce7842791849 response_code = 200 uri = /vpc-routes
22612024-12-21T07:48:53.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34414
22622024-12-21T07:48:53.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34414 req_id = 4b5942f9-af97-4c6b-96fa-728bdee4688b response_code = 200 uri = /vpc-routes
22632024-12-21T07:48:53.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51995
22642024-12-21T07:48:53.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51995 req_id = 1a987774-0f8c-4339-b3c0-236e1234d832 response_code = 200 uri = /v2p
22652024-12-21T07:48:53.811ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
22662024-12-21T07:48:53.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34414 req_id = 5d9f40e5-f924-4004-9dd7-3073b9bc2087 response_code = 204 uri = /eip-gateways
22672024-12-21T07:48:53.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34414 req_id = f65adec9-8f17-4c41-98a8-06e0aff5e2dd response_code = 204 uri = /vpc-routes
22682024-12-21T07:48:53.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60967
22692024-12-21T07:48:53.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60967 req_id = f7769484-a522-4a63-8429-3d593b5fca48 response_code = 200 uri = /v2p
22702024-12-21T07:48:53.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43265
22712024-12-21T07:48:53.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43265 req_id = ccad14b5-92eb-49d9-bd1f-b6ed98f36566 response_code = 200 uri = /vpc-routes
22722024-12-21T07:48:53.857ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
22732024-12-21T07:48:53.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43265 req_id = 2c98b07d-b375-41e1-8cd1-2289581ce9d8 response_code = 204 uri = /eip-gateways
22742024-12-21T07:48:53.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43265 req_id = bd0ca52f-fa73-4f2c-9afe-298cbca4fb8d response_code = 204 uri = /vpc-routes
22752024-12-21T07:48:53.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46949
22762024-12-21T07:48:53.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46949 req_id = 78dcd50a-0892-40ab-9a01-b80119400dca response_code = 200 uri = /v2p
22772024-12-21T07:48:53.984ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
22782024-12-21T07:48:53.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33222 req_id = 46cc9f80-c7d4-4e0e-bf6f-a2e8f1f8f047 response_code = 204 uri = /eip-gateways
22792024-12-21T07:48:53.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33222 req_id = b00eb895-3878-42a2-82d3-a087bf8cd76f response_code = 204 uri = /vpc-routes
22802024-12-21T07:48:54.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64450
22812024-12-21T07:48:54.075ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22822024-12-21T07:48:54.116ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22832024-12-21T07:48:54.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64450 req_id = dabb814f-f368-4ff3-b6bb-568b64d4c2a7 response_code = 204 uri = /switch-ports
22842024-12-21T07:48:54.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48668
22852024-12-21T07:48:54.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64450 req_id = 06c72045-dd5d-44ff-9011-e9091723aed8 response_code = 200 uri = /network-bootstore-config
22862024-12-21T07:48:54.175ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22872024-12-21T07:48:54.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34471
22882024-12-21T07:48:54.212ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22892024-12-21T07:48:54.265ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22902024-12-21T07:48:54.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48668 req_id = 5c57ac65-b159-4671-aa38-6fe77b46dbc8 response_code = 204 uri = /switch-ports
22912024-12-21T07:48:54.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48668 req_id = 86c25222-10c7-4d1d-96eb-135529f0dc3c response_code = 200 uri = /network-bootstore-config
22922024-12-21T07:48:54.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22932024-12-21T07:48:54.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34471 req_id = 9a09685a-32a7-4802-ac05-447b9c65ef6f response_code = 204 uri = /switch-ports
22942024-12-21T07:48:54.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34471 req_id = 7eb57338-1ced-4b03-9878-402458eaa5d1 response_code = 200 uri = /network-bootstore-config
22952024-12-21T07:49:05.903ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8340 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 7337adfc-f22b-4f63-b3b1-b70307d5636d response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
22962024-12-21T07:49:16.714ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43004
22972024-12-21T07:49:16.714ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43004 req_id = 49ad737b-7503-4bda-b532-6b86a76e9a7a response_code = 200 uri = /baseboard
22982024-12-21T07:49:23.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61665
22992024-12-21T07:49:23.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61665 req_id = d5777cd4-cd90-4af7-a4c3-6328ff59d593 response_code = 200 uri = /vpc-routes
23002024-12-21T07:49:23.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61986
23012024-12-21T07:49:23.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61986 req_id = 8af9ad26-016c-4831-897e-ee21b8768589 response_code = 200 uri = /vpc-routes
23022024-12-21T07:49:23.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53763
23032024-12-21T07:49:23.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53763 req_id = d92c42c8-a5b3-43a6-b347-a22d929fd30a response_code = 200 uri = /v2p
23042024-12-21T07:49:23.902ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
23052024-12-21T07:49:23.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61986 req_id = 6539bcd5-8ef1-488a-89c3-1b68a50ae8b9 response_code = 204 uri = /eip-gateways
23062024-12-21T07:49:23.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59772
23072024-12-21T07:49:23.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59772 req_id = 03795dfd-c55d-45b0-8e50-a942c961b21a response_code = 200 uri = /vpc-routes
23082024-12-21T07:49:23.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40509
23092024-12-21T07:49:23.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40509 req_id = e486d243-16d8-4c92-96d7-34270778d1f0 response_code = 200 uri = /v2p
23102024-12-21T07:49:23.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
23112024-12-21T07:49:23.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59772 req_id = 3c49252d-0a51-4331-9aba-7c21a9a8858d response_code = 204 uri = /eip-gateways
23122024-12-21T07:49:23.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61986 req_id = 16ab63c7-5f1a-402e-b5b9-07ae8cc9ff22 response_code = 204 uri = /vpc-routes
23132024-12-21T07:49:23.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59772 req_id = f4c84376-d3e8-416c-a405-4fc99e6eb16a response_code = 204 uri = /vpc-routes
23142024-12-21T07:49:24.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52386
23152024-12-21T07:49:24.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52386 req_id = 8aa20df4-cd9c-4efe-ba6d-5fcf41b3bc61 response_code = 200 uri = /v2p
23162024-12-21T07:49:24.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63107
23172024-12-21T07:49:24.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23182024-12-21T07:49:24.103ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23192024-12-21T07:49:24.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63107 req_id = 23e5a9ad-ff76-4b4c-b83a-7ea824dcf070 response_code = 204 uri = /switch-ports
23202024-12-21T07:49:24.166ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
23212024-12-21T07:49:24.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61665 req_id = fe5a8d5a-1677-4354-ad6f-3b61053a6ccf response_code = 204 uri = /eip-gateways
23222024-12-21T07:49:24.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63107 req_id = c8e658ce-89da-4771-af45-fe7df72cfb30 response_code = 200 uri = /network-bootstore-config
23232024-12-21T07:49:24.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61665 req_id = 01ddb0b6-83f8-42f0-88b1-6e56b49a4711 response_code = 204 uri = /vpc-routes
23242024-12-21T07:49:24.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47286
23252024-12-21T07:49:24.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23262024-12-21T07:49:24.236ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23272024-12-21T07:49:24.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98419 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47286 req_id = 7600fd09-a571-4a4e-8206-f5b6b25eeb20 response_code = 204 uri = /switch-ports
23282024-12-21T07:49:24.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50351
23292024-12-21T07:49:24.297ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23302024-12-21T07:49:24.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47286 req_id = de3b6bce-7c4e-4d1f-8d8e-14f1ac2ad019 response_code = 200 uri = /network-bootstore-config
23312024-12-21T07:49:24.332ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23322024-12-21T07:49:24.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50351 req_id = 7f6906d9-7ef6-40eb-92e1-a0c8dff64b88 response_code = 204 uri = /switch-ports
23332024-12-21T07:49:24.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50351 req_id = 315b8f4c-6de5-447a-b0fe-5fd0b70b8f85 response_code = 200 uri = /network-bootstore-config
23342024-12-21T07:49:35.902ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6979 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 0a18901a-f938-4025-a548-45f1eecd8da3 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
23352024-12-21T07:49:39.740ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23362024-12-21T07:49:46.748ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40599
23372024-12-21T07:49:46.748ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40599 req_id = 654a803c-10ec-4772-b518-85b8cb1ef9e4 response_code = 200 uri = /baseboard
23382024-12-21T07:49:53.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54967
23392024-12-21T07:49:53.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54967 req_id = a8932537-0f59-4258-b0b1-657824fafd56 response_code = 200 uri = /vpc-routes
23402024-12-21T07:49:53.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51273
23412024-12-21T07:49:53.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51273 req_id = 6f4cc753-2aad-453f-959b-800437405898 response_code = 200 uri = /vpc-routes
23422024-12-21T07:49:53.728ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
23432024-12-21T07:49:53.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54967 req_id = 33be6e5f-a142-4bf8-ab57-807aeb76838d response_code = 204 uri = /eip-gateways
23442024-12-21T07:49:53.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54967 req_id = 125b9368-38d2-49f7-9ad6-7d29909b4773 response_code = 204 uri = /vpc-routes
23452024-12-21T07:49:53.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37056
23462024-12-21T07:49:53.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37056 req_id = ee49da06-2614-4d6f-93b5-3e9a644444b5 response_code = 200 uri = /vpc-routes
23472024-12-21T07:49:53.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
23482024-12-21T07:49:53.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37056 req_id = f836c288-0310-4bb8-8ba7-127cc54674fc response_code = 204 uri = /eip-gateways
23492024-12-21T07:49:53.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
23502024-12-21T07:49:53.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51273 req_id = 315736a8-c9c9-43ad-9073-419decd57e47 response_code = 204 uri = /eip-gateways
23512024-12-21T07:49:53.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37056 req_id = 4ecd87a4-0c39-47e6-a265-741132c0da55 response_code = 204 uri = /vpc-routes
23522024-12-21T07:49:53.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51273 req_id = 2a6da818-c2bd-4ed6-bd82-185cc49e287d response_code = 204 uri = /vpc-routes
23532024-12-21T07:49:53.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36454
23542024-12-21T07:49:53.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36454 req_id = 22e33c96-dfbc-4b08-953c-de02fab18847 response_code = 200 uri = /v2p
23552024-12-21T07:49:53.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39634
23562024-12-21T07:49:53.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39634 req_id = d4118d74-6071-481f-8efb-4c083fe6605b response_code = 200 uri = /v2p
23572024-12-21T07:49:53.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40583
23582024-12-21T07:49:53.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23592024-12-21T07:49:53.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23602024-12-21T07:49:53.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98157 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40583 req_id = 4c5f165c-d9fb-4951-aee3-e206152080c1 response_code = 204 uri = /switch-ports
23612024-12-21T07:49:53.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54344
23622024-12-21T07:49:53.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33121
23632024-12-21T07:49:53.958ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23642024-12-21T07:49:53.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40583 req_id = 398f4530-f838-449b-8840-2c636b857717 response_code = 200 uri = /network-bootstore-config
23652024-12-21T07:49:53.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3580 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33121 req_id = 695e10c4-7967-4baf-831c-89aed7b586cf response_code = 200 uri = /v2p
23662024-12-21T07:49:53.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33170
23672024-12-21T07:49:53.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23682024-12-21T07:49:54.052ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23692024-12-21T07:49:54.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94479 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54344 req_id = 080a5d97-15a1-4947-a2a4-5ca384edde97 response_code = 204 uri = /switch-ports
23702024-12-21T07:49:54.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54344 req_id = 24ebc100-5cdc-4b32-a1f4-b5daecee5f29 response_code = 200 uri = /network-bootstore-config
23712024-12-21T07:49:54.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23722024-12-21T07:49:54.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33170 req_id = 010cc991-399c-44f6-a97f-6a542fabaa23 response_code = 204 uri = /switch-ports
23732024-12-21T07:49:54.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33170 req_id = 3e08ad51-1d61-4aa9-8fbc-a39576580ed4 response_code = 200 uri = /network-bootstore-config
23742024-12-21T07:50:05.902ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6780 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = a8133e45-1281-4591-b617-23d52948d11d response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
23752024-12-21T07:50:16.781ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54209
23762024-12-21T07:50:16.781ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54209 req_id = a8bda9fb-1ea5-4bfc-af1e-835ac7cd80f8 response_code = 200 uri = /baseboard
23772024-12-21T07:50:23.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34814
23782024-12-21T07:50:23.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34814 req_id = 4ee9c47b-995b-4133-82c4-2d59e30fadd3 response_code = 200 uri = /vpc-routes
23792024-12-21T07:50:23.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59555
23802024-12-21T07:50:23.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59555 req_id = beaf7913-4b44-4b5c-8813-a39a243eefa1 response_code = 200 uri = /vpc-routes
23812024-12-21T07:50:23.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39932
23822024-12-21T07:50:23.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39932 req_id = 32ace3f1-7f7e-410f-be83-27b080cf175c response_code = 200 uri = /v2p
23832024-12-21T07:50:24.013ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
23842024-12-21T07:50:24.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34814 req_id = d3859f6e-91c2-41f6-a870-b95c80d546f7 response_code = 204 uri = /eip-gateways
23852024-12-21T07:50:24.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
23862024-12-21T07:50:24.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59555 req_id = 01d962f5-3a04-4f60-bd3f-cc37ce7419c8 response_code = 204 uri = /eip-gateways
23872024-12-21T07:50:24.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54170
23882024-12-21T07:50:24.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23892024-12-21T07:50:24.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23902024-12-21T07:50:24.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105543 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54170 req_id = 43334661-aaef-4e1c-9ab1-4fb2edcef945 response_code = 204 uri = /switch-ports
23912024-12-21T07:50:24.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46865
23922024-12-21T07:50:24.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53766
23932024-12-21T07:50:24.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54170 req_id = 03f38007-625e-440f-91e2-7a23b25efae5 response_code = 200 uri = /network-bootstore-config
23942024-12-21T07:50:24.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 638 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59555 req_id = 9c5f1938-de01-4cc0-b83b-54b58370606c response_code = 204 uri = /vpc-routes
23952024-12-21T07:50:24.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46865 req_id = a2584b0d-90ef-4396-a765-d66030b08126 response_code = 200 uri = /vpc-routes
23962024-12-21T07:50:24.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53766 req_id = bb16b6be-7ba5-4e61-92f0-e42b066f9be3 response_code = 200 uri = /v2p
23972024-12-21T07:50:24.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 618 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34814 req_id = 93823bce-da82-45e3-aef0-aa443d882f2b response_code = 204 uri = /vpc-routes
23982024-12-21T07:50:24.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45446
23992024-12-21T07:50:24.144ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24002024-12-21T07:50:24.184ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24012024-12-21T07:50:24.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45446 req_id = 28af606e-ef3f-4234-8cc2-e823ae9159bd response_code = 204 uri = /switch-ports
24022024-12-21T07:50:24.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42476
24032024-12-21T07:50:24.235ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
24042024-12-21T07:50:24.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46865 req_id = 1e9fcc36-6157-4130-9453-9291887a53b2 response_code = 204 uri = /eip-gateways
24052024-12-21T07:50:24.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48840
24062024-12-21T07:50:24.235ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24072024-12-21T07:50:24.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45446 req_id = 9fc40489-a5a3-4d2a-8f2d-62ef0922763d response_code = 200 uri = /network-bootstore-config
24082024-12-21T07:50:24.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48840 req_id = fe26846f-f92c-4d0f-a1dd-8dea45399b16 response_code = 200 uri = /v2p
24092024-12-21T07:50:24.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46865 req_id = 45c20e08-9f87-48fb-b39f-d1b7d4916941 response_code = 204 uri = /vpc-routes
24102024-12-21T07:50:24.272ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24112024-12-21T07:50:24.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98843 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42476 req_id = 9cb57c46-c7e2-4b03-a4a1-0f28d61c91b9 response_code = 204 uri = /switch-ports
24122024-12-21T07:50:24.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42476 req_id = 02858e44-fe5d-4f1f-a9ef-bcdb3806c729 response_code = 200 uri = /network-bootstore-config
24132024-12-21T07:50:35.903ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7205 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 23306be8-2e7a-41a0-abbb-cdd5b295f3ee response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
24142024-12-21T07:50:46.813ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42134
24152024-12-21T07:50:46.813ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42134 req_id = f4ad1db9-a300-42f2-b663-efb11cfe8cb1 response_code = 200 uri = /baseboard
24162024-12-21T07:50:53.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56484
24172024-12-21T07:50:53.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56484 req_id = 52644ad6-ea0e-4e0b-9be0-270451dfcb1d response_code = 200 uri = /vpc-routes
24182024-12-21T07:50:53.670ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
24192024-12-21T07:50:53.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56484 req_id = ee70aa1a-d1eb-4727-9425-743129e6c6fa response_code = 204 uri = /eip-gateways
24202024-12-21T07:50:53.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56484 req_id = 70775aa0-2e1f-4a79-8142-096d45b48c88 response_code = 204 uri = /vpc-routes
24212024-12-21T07:50:53.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47165
24222024-12-21T07:50:53.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47165 req_id = 3eee675d-72d9-4d82-b2d4-10f97bbda689 response_code = 200 uri = /vpc-routes
24232024-12-21T07:50:53.737ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
24242024-12-21T07:50:53.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47165 req_id = 9f67ccde-2052-4ec1-8372-94946a68747f response_code = 204 uri = /eip-gateways
24252024-12-21T07:50:53.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40207
24262024-12-21T07:50:53.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40207 req_id = d150e4a4-c186-42e1-a086-0cc02ae2e20d response_code = 200 uri = /v2p
24272024-12-21T07:50:53.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51740
24282024-12-21T07:50:53.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51740 req_id = 3e3b3a85-59cd-4c62-b86b-abc9bd2c8ff0 response_code = 200 uri = /v2p
24292024-12-21T07:50:53.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47165 req_id = b9dd8185-b8b2-4675-a6f1-099096bbfa5b response_code = 204 uri = /vpc-routes
24302024-12-21T07:50:53.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45374
24312024-12-21T07:50:53.804ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24322024-12-21T07:50:53.845ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24332024-12-21T07:50:53.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45374 req_id = 635026c6-06c6-4b8a-b8ee-d4d5840b3777 response_code = 204 uri = /switch-ports
24342024-12-21T07:50:53.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65392
24352024-12-21T07:50:53.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65294
24362024-12-21T07:50:53.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65294 req_id = ed0f44bc-18dc-4b28-a99a-1afb3a3ee72f response_code = 200 uri = /vpc-routes
24372024-12-21T07:50:53.917ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24382024-12-21T07:50:53.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
24392024-12-21T07:50:53.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65294 req_id = 7c5df429-9739-4cb8-ba9f-ea95f3d3504d response_code = 204 uri = /eip-gateways
24402024-12-21T07:50:53.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 592 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45374 req_id = 07808973-621c-4aa9-84fe-71d730bd573f response_code = 200 uri = /network-bootstore-config
24412024-12-21T07:50:53.957ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24422024-12-21T07:50:53.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54683
24432024-12-21T07:50:53.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54683 req_id = b48f9f0b-a2a0-4309-960a-86aa00886c33 response_code = 200 uri = /v2p
24442024-12-21T07:50:53.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65294 req_id = ae742abc-3397-4111-9157-4e387ceaa75f response_code = 204 uri = /vpc-routes
24452024-12-21T07:50:53.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47351
24462024-12-21T07:50:54.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24472024-12-21T07:50:54.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102354 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65392 req_id = c5fae4fa-ec65-4b73-9843-7ea77661bd80 response_code = 204 uri = /switch-ports
24482024-12-21T07:50:54.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 730 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65392 req_id = 44e69c9d-d7d5-4182-8e3b-a208d9aeec35 response_code = 200 uri = /network-bootstore-config
24492024-12-21T07:50:54.057ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24502024-12-21T07:50:54.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47351 req_id = 132010c1-2f75-487c-82c7-b02bfb092eab response_code = 204 uri = /switch-ports
24512024-12-21T07:50:54.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47351 req_id = ef772996-939b-42b2-a8cc-1ffca60135e7 response_code = 200 uri = /network-bootstore-config
24522024-12-21T07:51:05.903ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6702 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 6953473c-240d-44e2-977c-9f789af3bfbb response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
24532024-12-21T07:51:16.846ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34839
24542024-12-21T07:51:16.847ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34839 req_id = 16859c27-b070-4dc7-87b3-bebc5a239008 response_code = 200 uri = /baseboard
24552024-12-21T07:51:23.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42521
24562024-12-21T07:51:23.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42521 req_id = 29906bd7-9fa9-4280-8b3d-bf2065f80178 response_code = 200 uri = /vpc-routes
24572024-12-21T07:51:23.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38963
24582024-12-21T07:51:23.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38963 req_id = 30925a49-710e-4622-8629-d27b1f29a9fb response_code = 200 uri = /vpc-routes
24592024-12-21T07:51:23.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59913
24602024-12-21T07:51:23.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59913 req_id = 329280da-97bf-493a-bb04-a5d24323e413 response_code = 200 uri = /vpc-routes
24612024-12-21T07:51:23.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
24622024-12-21T07:51:23.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59913 req_id = 49a89006-c696-4773-977e-47986784b3bd response_code = 204 uri = /eip-gateways
24632024-12-21T07:51:23.936ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
24642024-12-21T07:51:23.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42521 req_id = 7831ee13-7bf8-4207-8a98-612b9a70ba87 response_code = 204 uri = /eip-gateways
24652024-12-21T07:51:23.937ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
24662024-12-21T07:51:23.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38963 req_id = f1b200f4-ba18-458f-8be9-1f6dc45fea7a response_code = 204 uri = /eip-gateways
24672024-12-21T07:51:23.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59913 req_id = bdf2fa75-5182-4d71-bce2-8a42fc00a012 response_code = 204 uri = /vpc-routes
24682024-12-21T07:51:23.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35091
24692024-12-21T07:51:23.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35091 req_id = 2782435a-acc3-4770-a028-b9a3457cbff0 response_code = 200 uri = /v2p
24702024-12-21T07:51:23.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42521 req_id = 7b9a2bdf-598f-4cf7-a2e8-2cd878c41ae7 response_code = 204 uri = /vpc-routes
24712024-12-21T07:51:23.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38963 req_id = 302c5339-ff03-4a81-82c8-2adeb4c5c92a response_code = 204 uri = /vpc-routes
24722024-12-21T07:51:24.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48557
24732024-12-21T07:51:24.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48557 req_id = 03bc446d-9fca-41ac-9a99-62c244d75216 response_code = 200 uri = /v2p
24742024-12-21T07:51:24.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56570
24752024-12-21T07:51:24.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24762024-12-21T07:51:24.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24772024-12-21T07:51:24.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56570 req_id = 383d8b8a-76a1-4ef8-82a8-7c5f7ba91d7a response_code = 204 uri = /switch-ports
24782024-12-21T07:51:24.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46082
24792024-12-21T07:51:24.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42041
24802024-12-21T07:51:24.147ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24812024-12-21T07:51:24.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46082 req_id = 23a297de-0356-473e-a358-26b4048f2944 response_code = 200 uri = /v2p
24822024-12-21T07:51:24.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56570 req_id = af6612a0-61b3-4a2f-a43c-15dd5270dc09 response_code = 200 uri = /network-bootstore-config
24832024-12-21T07:51:24.184ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24842024-12-21T07:51:24.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90333 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42041 req_id = 55c12601-808d-4663-9352-39f5203d099c response_code = 204 uri = /switch-ports
24852024-12-21T07:51:24.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42041 req_id = d9a38a9f-5fe8-4303-87e2-0d85ccf85a96 response_code = 200 uri = /network-bootstore-config
24862024-12-21T07:51:24.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58317
24872024-12-21T07:51:24.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24882024-12-21T07:51:24.296ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24892024-12-21T07:51:24.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89080 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58317 req_id = f87818a8-1aa1-4255-b4a0-cb8de495dcb0 response_code = 204 uri = /switch-ports
24902024-12-21T07:51:24.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58317 req_id = e0b2b5dd-16da-469d-bc0e-77e7433bb5e5 response_code = 200 uri = /network-bootstore-config
24912024-12-21T07:51:35.903ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7091 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 7f7903ea-cabf-4f5f-8e00-be3457c33df6 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
24922024-12-21T07:51:46.879ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33954
24932024-12-21T07:51:46.879ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33954 req_id = 6c75d598-e8c6-431c-8f19-57a64812ace7 response_code = 200 uri = /baseboard
24942024-12-21T07:51:53.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57971
24952024-12-21T07:51:53.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57971 req_id = 1360d781-b19c-4e5e-9b53-c1c836e71e25 response_code = 200 uri = /vpc-routes
24962024-12-21T07:51:53.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64626
24972024-12-21T07:51:53.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64626 req_id = f9168faa-65b5-424a-bae2-bfb0dbca53a5 response_code = 200 uri = /vpc-routes
24982024-12-21T07:51:53.768ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
24992024-12-21T07:51:53.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57971 req_id = 1c52a3a9-3521-4aaf-aad1-54bce5a883df response_code = 204 uri = /eip-gateways
25002024-12-21T07:51:53.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57971 req_id = 8125cb5f-af87-4399-b2b5-58238a4969e0 response_code = 204 uri = /vpc-routes
25012024-12-21T07:51:53.784ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
25022024-12-21T07:51:53.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64626 req_id = 8f29d1f3-93c2-4cf0-a78b-44d35f5a9fff response_code = 204 uri = /eip-gateways
25032024-12-21T07:51:53.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64626 req_id = cfbe120b-32fb-4e5f-995c-cb3ab926ec6f response_code = 204 uri = /vpc-routes
25042024-12-21T07:51:53.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61473
25052024-12-21T07:51:53.814ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25062024-12-21T07:51:53.863ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25072024-12-21T07:51:53.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61473 req_id = f376122a-1c33-423b-8bcd-2997ba9c4f87 response_code = 204 uri = /switch-ports
25082024-12-21T07:51:53.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43482
25092024-12-21T07:51:53.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45231
25102024-12-21T07:51:53.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54867
25112024-12-21T07:51:53.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35357
25122024-12-21T07:51:53.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33624
25132024-12-21T07:51:53.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25142024-12-21T07:51:53.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3875 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35357 req_id = 3684052a-dfc9-4a6d-b674-a20167ccc49c response_code = 200 uri = /v2p
25152024-12-21T07:51:53.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4085 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45231 req_id = 113b3588-4934-41bf-ae93-878b428ecf09 response_code = 200 uri = /v2p
25162024-12-21T07:51:53.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4007 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33624 req_id = c4fc84e7-7a17-4588-9828-bc053a99e5bc response_code = 200 uri = /v2p
25172024-12-21T07:51:53.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43482 req_id = 504e0eb2-1fbc-42a0-aeee-b8fb559cbe40 response_code = 200 uri = /vpc-routes
25182024-12-21T07:51:53.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61473 req_id = 40f2e5c8-5857-43ef-93c7-a4979298ea7b response_code = 200 uri = /network-bootstore-config
25192024-12-21T07:51:53.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33414
25202024-12-21T07:51:53.959ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25212024-12-21T07:51:53.970ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
25222024-12-21T07:51:53.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43482 req_id = 42415972-1b58-41c2-9784-2356d7b19a87 response_code = 204 uri = /eip-gateways
25232024-12-21T07:51:53.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43482 req_id = 1b64940c-934c-492a-8475-201bb89f85b4 response_code = 204 uri = /vpc-routes
25242024-12-21T07:51:54.018ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25252024-12-21T07:51:54.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96004 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54867 req_id = 899124fd-036f-4edf-9f0d-9c40c8c7e03d response_code = 204 uri = /switch-ports
25262024-12-21T07:51:54.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 704 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54867 req_id = 5d6c7197-d059-4dfb-ba9f-211b71e6499f response_code = 200 uri = /network-bootstore-config
25272024-12-21T07:51:54.055ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25282024-12-21T07:51:54.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33414 req_id = 0b51c4cb-21c7-4999-a5b2-042893c62ad6 response_code = 204 uri = /switch-ports
25292024-12-21T07:51:54.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33414 req_id = f37ba083-af32-486c-83a6-faec7f736ea4 response_code = 200 uri = /network-bootstore-config
25302024-12-21T07:52:05.903ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6709 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = eb8af649-6092-4efd-87b9-d29684c1d029 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
25312024-12-21T07:52:16.913ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37925
25322024-12-21T07:52:16.913ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37925 req_id = e86bea05-6035-4bfa-a9ae-34dabe09a85d response_code = 200 uri = /baseboard
25332024-12-21T07:52:23.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38099
25342024-12-21T07:52:23.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38099 req_id = d0b778a2-12c9-4a6c-8e3e-2960b91a1509 response_code = 200 uri = /v2p
25352024-12-21T07:52:23.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55765
25362024-12-21T07:52:23.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55765 req_id = a7334111-d921-4bf3-98f7-d447e53d69a7 response_code = 200 uri = /vpc-routes
25372024-12-21T07:52:23.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56301
25382024-12-21T07:52:23.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56301 req_id = 6843bf4f-37d6-4eb4-9b83-3d4c11be255f response_code = 200 uri = /vpc-routes
25392024-12-21T07:52:23.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64165
25402024-12-21T07:52:23.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64165 req_id = 6b1ab10f-92a5-443e-9357-895a0f398f77 response_code = 200 uri = /vpc-routes
25412024-12-21T07:52:23.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
25422024-12-21T07:52:23.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55765 req_id = f19ba216-6491-4179-b135-4dc41cbb99cb response_code = 204 uri = /eip-gateways
25432024-12-21T07:52:23.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55765 req_id = 4d386002-9292-40d9-bc39-3b34bc1ba0a3 response_code = 204 uri = /vpc-routes
25442024-12-21T07:52:23.999ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
25452024-12-21T07:52:23.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56301 req_id = 2060cbac-26b5-4d48-89cc-374903735f70 response_code = 204 uri = /eip-gateways
25462024-12-21T07:52:24.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
25472024-12-21T07:52:24.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64165 req_id = e75c7ac9-a3d9-4bc8-81d8-3f8688ec16ea response_code = 204 uri = /eip-gateways
25482024-12-21T07:52:24.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56301 req_id = ae788e15-9df9-4ac7-b1e8-0051666e4101 response_code = 204 uri = /vpc-routes
25492024-12-21T07:52:24.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48133
25502024-12-21T07:52:24.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48133 req_id = 433d15e6-9500-4bc5-86cf-f702f8909d53 response_code = 200 uri = /v2p
25512024-12-21T07:52:24.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64165 req_id = a399ff1f-c629-4b9a-9d40-2817f217f8dc response_code = 204 uri = /vpc-routes
25522024-12-21T07:52:24.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60539
25532024-12-21T07:52:24.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60539 req_id = 467444fe-f689-48ea-87e0-d04bd17f3506 response_code = 200 uri = /v2p
25542024-12-21T07:52:24.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63557
25552024-12-21T07:52:24.120ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25562024-12-21T07:52:24.162ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25572024-12-21T07:52:24.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106625 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63557 req_id = 153cf9cf-f031-4280-8add-95d96058f432 response_code = 204 uri = /switch-ports
25582024-12-21T07:52:24.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48506
25592024-12-21T07:52:24.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46858
25602024-12-21T07:52:24.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53247
25612024-12-21T07:52:24.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64703
25622024-12-21T07:52:24.227ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25632024-12-21T07:52:24.227ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25642024-12-21T07:52:24.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25652024-12-21T07:52:24.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63557 req_id = 741b37f7-1e94-47d0-9c99-0af72b76e8ea response_code = 200 uri = /network-bootstore-config
25662024-12-21T07:52:24.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25672024-12-21T07:52:24.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25682024-12-21T07:52:24.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25692024-12-21T07:52:24.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25702024-12-21T07:52:24.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25712024-12-21T07:52:24.231ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25722024-12-21T07:52:24.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25732024-12-21T07:52:24.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25742024-12-21T07:52:24.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25752024-12-21T07:52:24.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25762024-12-21T07:52:24.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25772024-12-21T07:52:24.232ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25782024-12-21T07:52:24.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64703 req_id = c5c531c8-aa6e-404a-a80f-4dae732a5409 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25792024-12-21T07:52:24.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53247 req_id = a2472d58-c16f-4441-8c22-8b5f80cbc3fb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25802024-12-21T07:52:24.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52198
25812024-12-21T07:52:24.251ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25822024-12-21T07:52:24.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25832024-12-21T07:52:24.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25842024-12-21T07:52:24.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25852024-12-21T07:52:24.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25862024-12-21T07:52:24.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25872024-12-21T07:52:24.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25882024-12-21T07:52:24.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52198 req_id = 002cc212-465d-4225-90fe-6f06b3a3d393 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25892024-12-21T07:52:24.265ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25902024-12-21T07:52:24.320ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25912024-12-21T07:52:24.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93410 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46858 req_id = 21307ef4-e4eb-4105-a7e8-13a34bf3b56c response_code = 204 uri = /switch-ports
25922024-12-21T07:52:24.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 715 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46858 req_id = 64435518-1ec0-4fa2-95fb-4b7084809709 response_code = 200 uri = /network-bootstore-config
25932024-12-21T07:52:24.358ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25942024-12-21T07:52:24.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48506 req_id = b683114e-ac4e-45ee-8803-fc6c158f85d7 response_code = 204 uri = /switch-ports
25952024-12-21T07:52:24.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48506 req_id = 4a03d13d-fe0a-4eff-9d9b-a550731b07b9 response_code = 200 uri = /network-bootstore-config
25962024-12-21T07:52:35.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7794 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = e91dd625-4e49-4750-ba96-f83717df4129 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
25972024-12-21T07:52:46.947ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61238
25982024-12-21T07:52:46.947ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61238 req_id = cdcd9d5b-152a-4a9d-a77e-e6bc2753d431 response_code = 200 uri = /baseboard
25992024-12-21T07:52:53.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60309
26002024-12-21T07:52:53.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60309 req_id = 2a4529bc-05b0-49d8-a154-0f9b1349bdd5 response_code = 200 uri = /vpc-routes
26012024-12-21T07:52:53.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
26022024-12-21T07:52:53.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60309 req_id = eb0fa500-b36f-4e96-8604-f2256b217331 response_code = 204 uri = /eip-gateways
26032024-12-21T07:52:53.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60309 req_id = 50579696-230e-402c-a9eb-38c85bae6fda response_code = 204 uri = /vpc-routes
26042024-12-21T07:52:53.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64752
26052024-12-21T07:52:53.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64752 req_id = 4a8d7c4e-ed03-4edd-9d02-cd2d0d527836 response_code = 200 uri = /vpc-routes
26062024-12-21T07:52:53.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56461
26072024-12-21T07:52:53.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56461 req_id = 10fb1faf-f1b7-473a-8159-da9e1cf3b36e response_code = 200 uri = /vpc-routes
26082024-12-21T07:52:53.845ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
26092024-12-21T07:52:53.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64752 req_id = 4fd22108-4951-47be-906a-a29d30257fe0 response_code = 204 uri = /eip-gateways
26102024-12-21T07:52:53.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40785
26112024-12-21T07:52:53.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40785 req_id = 9cb7a587-5866-4ad3-97f1-4301ca88ded3 response_code = 200 uri = /v2p
26122024-12-21T07:52:53.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64752 req_id = 6c6ebae4-abd7-42dd-aa2c-d5ff71a1f363 response_code = 204 uri = /vpc-routes
26132024-12-21T07:52:53.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34887
26142024-12-21T07:52:53.868ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26152024-12-21T07:52:53.910ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26162024-12-21T07:52:53.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98595 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34887 req_id = a8df76c6-ff25-400f-973b-5381377a9095 response_code = 204 uri = /switch-ports
26172024-12-21T07:52:53.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47935
26182024-12-21T07:52:53.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58270
26192024-12-21T07:52:53.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
26202024-12-21T07:52:53.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56461 req_id = 0e37bdcf-e6ce-44fe-b48b-7b442d057099 response_code = 204 uri = /eip-gateways
26212024-12-21T07:52:53.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34887 req_id = ef45e7b2-2aef-4464-b8a0-ea51f62ab8a7 response_code = 200 uri = /network-bootstore-config
26222024-12-21T07:52:53.968ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26232024-12-21T07:52:53.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58270 req_id = 0491fad7-2d8b-438f-9b56-b8c942a36580 response_code = 200 uri = /v2p
26242024-12-21T07:52:53.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54442
26252024-12-21T07:52:53.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54442 req_id = f7e70768-61aa-447e-b36b-88f0e1124498 response_code = 200 uri = /v2p
26262024-12-21T07:52:53.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56461 req_id = 42c50d8c-04e5-4f35-9668-b62db780059a response_code = 204 uri = /vpc-routes
26272024-12-21T07:52:53.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35386
26282024-12-21T07:52:54.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26292024-12-21T07:52:54.064ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26302024-12-21T07:52:54.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47935 req_id = 2b8f2004-d7f3-4cb4-bc04-76584a3ef4a5 response_code = 204 uri = /switch-ports
26312024-12-21T07:52:54.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 454 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47935 req_id = 7d14a927-b833-4628-bd33-7220a7fa1600 response_code = 200 uri = /network-bootstore-config
26322024-12-21T07:52:54.100ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26332024-12-21T07:52:54.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35386 req_id = 98d961ca-64d5-402c-866f-e55d6249d5fe response_code = 204 uri = /switch-ports
26342024-12-21T07:52:54.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35386 req_id = 0c887af7-0995-4d16-97ed-5dbf01f46db7 response_code = 200 uri = /network-bootstore-config
26352024-12-21T07:53:05.904ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6887 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 6203bb44-2f40-4613-a774-de0f8b75c89a response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
26362024-12-21T07:53:16.982ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58042
26372024-12-21T07:53:16.982ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58042 req_id = d97b6d5e-2071-40df-a012-7ae40cd2c43a response_code = 200 uri = /baseboard
26382024-12-21T07:53:23.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59744
26392024-12-21T07:53:23.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59744 req_id = 4ca791a9-ac27-4c1e-80c1-a19a0e639e47 response_code = 200 uri = /vpc-routes
26402024-12-21T07:53:23.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63358
26412024-12-21T07:53:23.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63358 req_id = f0138961-f890-4c8e-8c3f-d30e07dc7614 response_code = 200 uri = /vpc-routes
26422024-12-21T07:53:24.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63475
26432024-12-21T07:53:24.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63475 req_id = 48203997-2454-4e6e-a62b-9ba16e4e2c9b response_code = 200 uri = /v2p
26442024-12-21T07:53:24.032ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
26452024-12-21T07:53:24.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59744 req_id = f8cfcce4-ccf2-4aad-8c27-6e0b00c2ca74 response_code = 204 uri = /eip-gateways
26462024-12-21T07:53:24.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59744 req_id = f6a53651-72f3-40aa-a232-594c8c3b70e9 response_code = 204 uri = /vpc-routes
26472024-12-21T07:53:24.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
26482024-12-21T07:53:24.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63358 req_id = 507d8823-12b3-49c2-a3ad-a805658faa71 response_code = 204 uri = /eip-gateways
26492024-12-21T07:53:24.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63358 req_id = 591da44a-09f1-4660-817c-ff8522bfadcf response_code = 204 uri = /vpc-routes
26502024-12-21T07:53:24.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52310
26512024-12-21T07:53:24.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52310 req_id = 52b9dbdf-c658-41a1-a30a-dc5237f8a542 response_code = 200 uri = /vpc-routes
26522024-12-21T07:53:24.124ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
26532024-12-21T07:53:24.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52310 req_id = e306992a-bcd4-4de7-b772-18fcdb30fa22 response_code = 204 uri = /eip-gateways
26542024-12-21T07:53:24.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56336
26552024-12-21T07:53:24.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56336 req_id = 475ce8e7-bdde-4ad4-8ad0-f956074c603d response_code = 200 uri = /v2p
26562024-12-21T07:53:24.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52310 req_id = 610d43b7-dbb7-40d0-a006-e3c5276fec79 response_code = 204 uri = /vpc-routes
26572024-12-21T07:53:24.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41904
26582024-12-21T07:53:24.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41904 req_id = 4d1340b3-f131-4d39-8f13-c8475bf28d64 response_code = 200 uri = /v2p
26592024-12-21T07:53:24.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55678
26602024-12-21T07:53:24.173ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26612024-12-21T07:53:24.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26622024-12-21T07:53:24.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101809 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55678 req_id = db938934-711c-4d49-a7a2-c23c819bb9f2 response_code = 204 uri = /switch-ports
26632024-12-21T07:53:24.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49327
26642024-12-21T07:53:24.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46189
26652024-12-21T07:53:24.275ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26662024-12-21T07:53:24.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55678 req_id = 2866898e-f68f-4d71-90af-071e5f2e1e8f response_code = 200 uri = /network-bootstore-config
26672024-12-21T07:53:24.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26682024-12-21T07:53:24.363ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26692024-12-21T07:53:24.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88481 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49327 req_id = 31a7c7bb-35fd-4cb4-9664-3ba7eadae107 response_code = 204 uri = /switch-ports
26702024-12-21T07:53:24.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 722 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49327 req_id = 3f41febe-3fe2-423a-bbb5-c02740f7be2d response_code = 200 uri = /network-bootstore-config
26712024-12-21T07:53:24.398ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26722024-12-21T07:53:24.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46189 req_id = 37957750-9659-47bc-ae89-b2c55cf6cf15 response_code = 204 uri = /switch-ports
26732024-12-21T07:53:24.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46189 req_id = 1214edec-1228-4db1-87aa-5a414b02fb40 response_code = 200 uri = /network-bootstore-config
26742024-12-21T07:53:35.904ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6891 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 451fc33d-eb82-47e4-8110-6a6b729d7c3e response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
26752024-12-21T07:53:47.015ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47568
26762024-12-21T07:53:47.016ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47568 req_id = a3b43a33-8905-4a47-9dad-f48e06999586 response_code = 200 uri = /baseboard
26772024-12-21T07:53:53.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60134
26782024-12-21T07:53:53.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60134 req_id = 3f4c7f9a-9ed3-490a-8973-611dfe437df8 response_code = 200 uri = /vpc-routes
26792024-12-21T07:53:53.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
26802024-12-21T07:53:53.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60134 req_id = c7b746b8-899b-40ce-90e8-66e633fdd114 response_code = 204 uri = /eip-gateways
26812024-12-21T07:53:53.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60134 req_id = c83a0540-69c6-4809-ae63-ac591d6d8b47 response_code = 204 uri = /vpc-routes
26822024-12-21T07:53:53.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49459
26832024-12-21T07:53:53.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49459 req_id = 76b34330-d476-41bb-8a4a-7718666bd39c response_code = 200 uri = /vpc-routes
26842024-12-21T07:53:53.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43771
26852024-12-21T07:53:53.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43771 req_id = 1a77f8a8-07d6-4efe-a9b4-356063235ed9 response_code = 200 uri = /v2p
26862024-12-21T07:53:53.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
26872024-12-21T07:53:53.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49459 req_id = 51ef909e-1cca-46e7-a571-0c14205d52ea response_code = 204 uri = /eip-gateways
26882024-12-21T07:53:53.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49459 req_id = e82a537e-4e30-4d4e-a823-bb8e19080c4e response_code = 204 uri = /vpc-routes
26892024-12-21T07:53:53.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40672
26902024-12-21T07:53:53.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26912024-12-21T07:53:53.900ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26922024-12-21T07:53:53.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97581 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40672 req_id = 47468732-d480-4cf6-8630-7c82852e821d response_code = 204 uri = /switch-ports
26932024-12-21T07:53:53.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53471
26942024-12-21T07:53:53.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50219
26952024-12-21T07:53:53.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56241
26962024-12-21T07:53:53.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53471 req_id = 99916c14-3920-45e3-ba4b-39b499b52b7f response_code = 200 uri = /v2p
26972024-12-21T07:53:53.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40672 req_id = 1b6fb0f0-704d-49e7-bcc7-c6756e68c79b response_code = 200 uri = /network-bootstore-config
26982024-12-21T07:53:53.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56241 req_id = 345ec137-54ae-41a2-ba6f-7173514b6fe6 response_code = 200 uri = /vpc-routes
26992024-12-21T07:53:53.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50219 req_id = a9b50033-52b7-4608-bcbd-69e96eb72adb response_code = 200 uri = /v2p
27002024-12-21T07:53:53.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63940
27012024-12-21T07:53:53.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27022024-12-21T07:53:54.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
27032024-12-21T07:53:54.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56241 req_id = bc6f0c95-eb49-49c4-b51e-fb9cec554d6a response_code = 204 uri = /eip-gateways
27042024-12-21T07:53:54.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45530
27052024-12-21T07:53:54.006ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27062024-12-21T07:53:54.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1014 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56241 req_id = 3d635979-6b94-401d-8955-348514532b68 response_code = 204 uri = /vpc-routes
27072024-12-21T07:53:54.066ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27082024-12-21T07:53:54.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96509 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63940 req_id = e9672b79-b5c5-4b5c-b136-de49019e5edd response_code = 204 uri = /switch-ports
27092024-12-21T07:53:54.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 768 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63940 req_id = 87a65cf0-76e1-4ffd-a173-5f52415c47ef response_code = 200 uri = /network-bootstore-config
27102024-12-21T07:53:54.106ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27112024-12-21T07:53:54.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152095 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45530 req_id = 76c5fc4c-8240-4283-a335-87b703d9c056 response_code = 204 uri = /switch-ports
27122024-12-21T07:53:54.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45530 req_id = 4823aaf0-0b4a-4f29-ad95-abf530f2ebf4 response_code = 200 uri = /network-bootstore-config
27132024-12-21T07:54:05.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7384 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 3f3be33f-0fca-4e7f-ae42-d92d0c94000f response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
27142024-12-21T07:54:17.048ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39130
27152024-12-21T07:54:17.048ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39130 req_id = babddc7b-08a5-4d73-bc56-612feff5c5f1 response_code = 200 uri = /baseboard
27162024-12-21T07:54:23.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34696
27172024-12-21T07:54:23.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34696 req_id = c69e875c-ee5f-43e3-a591-6ded0850e5a3 response_code = 200 uri = /vpc-routes
27182024-12-21T07:54:23.918ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
27192024-12-21T07:54:23.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34696 req_id = e71f8c1f-5585-4bda-babd-1c713037e8e5 response_code = 204 uri = /eip-gateways
27202024-12-21T07:54:23.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52367
27212024-12-21T07:54:23.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52367 req_id = 869d8f3a-ca25-4556-b78b-95d1cd60f3a9 response_code = 200 uri = /v2p
27222024-12-21T07:54:23.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34696 req_id = 71075417-4f4a-45ed-835f-cde25eaef0b3 response_code = 204 uri = /vpc-routes
27232024-12-21T07:54:23.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46936
27242024-12-21T07:54:23.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46936 req_id = 1f337ef9-c2bb-4bcb-afe6-383234b5b81e response_code = 200 uri = /vpc-routes
27252024-12-21T07:54:23.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46620
27262024-12-21T07:54:23.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27272024-12-21T07:54:24.006ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27282024-12-21T07:54:24.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46620 req_id = d649e909-a7d7-4949-9e27-10a811fa4492 response_code = 204 uri = /switch-ports
27292024-12-21T07:54:24.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64503
27302024-12-21T07:54:24.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57929
27312024-12-21T07:54:24.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44845
27322024-12-21T07:54:24.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
27332024-12-21T07:54:24.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57929 req_id = 29cefc91-16a1-4cbd-8691-d73c0ea5cdd1 response_code = 200 uri = /vpc-routes
27342024-12-21T07:54:24.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46620 req_id = f59d2772-4a00-4877-904f-596281b360f7 response_code = 200 uri = /network-bootstore-config
27352024-12-21T07:54:24.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46936 req_id = 3e14a7bd-54c4-46c1-ad88-c78d9009130f response_code = 204 uri = /eip-gateways
27362024-12-21T07:54:24.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64503 req_id = b1362021-a831-4050-8d9a-e6d1dabe94e3 response_code = 200 uri = /v2p
27372024-12-21T07:54:24.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44845 req_id = 85b79b0a-7d81-4590-b732-02cefb919458 response_code = 200 uri = /v2p
27382024-12-21T07:54:24.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46936 req_id = 42f296ba-59d7-4b18-aae1-849e63c52396 response_code = 204 uri = /vpc-routes
27392024-12-21T07:54:24.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37903
27402024-12-21T07:54:24.069ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27412024-12-21T07:54:24.107ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27422024-12-21T07:54:24.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93098 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37903 req_id = bc14075b-3048-494c-b588-5003c148cc7b response_code = 204 uri = /switch-ports
27432024-12-21T07:54:24.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
27442024-12-21T07:54:24.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57929 req_id = f6476965-313b-4347-ba33-654a7cb8fb8d response_code = 204 uri = /eip-gateways
27452024-12-21T07:54:24.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62145
27462024-12-21T07:54:24.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37903 req_id = 0e3fdd19-ae28-43aa-a0a8-35c56bccbba4 response_code = 200 uri = /network-bootstore-config
27472024-12-21T07:54:24.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27482024-12-21T07:54:24.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57929 req_id = 2c185749-6e44-495e-bf6c-6a3e0d996c04 response_code = 204 uri = /vpc-routes
27492024-12-21T07:54:24.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27502024-12-21T07:54:24.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62145 req_id = d14d9a63-6697-4331-87d6-dfd4eaf2cbc6 response_code = 204 uri = /switch-ports
27512024-12-21T07:54:24.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62145 req_id = 3607c47d-14a0-4038-aff1-96c93f3d149f response_code = 200 uri = /network-bootstore-config
27522024-12-21T07:54:25.243ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
27532024-12-21T07:54:25.243ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27542024-12-21T07:54:25.279ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1985, tv_nsec: 228864003 } time_to_next_cleanup = 599.99999582s
27552024-12-21T07:54:35.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7161 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 521c9797-24ef-4d2d-9d0b-fe2764d35076 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
27562024-12-21T07:54:39.743ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
27572024-12-21T07:54:47.080ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57939
27582024-12-21T07:54:47.080ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57939 req_id = cee76f91-1111-4397-832f-7dbfb171e734 response_code = 200 uri = /baseboard
27592024-12-21T07:54:53.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36621
27602024-12-21T07:54:53.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36621 req_id = 3c1c125e-799b-4473-bc31-5a2bd9983424 response_code = 200 uri = /vpc-routes
27612024-12-21T07:54:53.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51112
27622024-12-21T07:54:53.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51112 req_id = 3298ca8a-955b-43c5-ab72-dee0fc4566b1 response_code = 200 uri = /vpc-routes
27632024-12-21T07:54:53.805ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
27642024-12-21T07:54:53.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36621 req_id = 804b7de2-7606-4458-a816-ed8265d61da2 response_code = 204 uri = /eip-gateways
27652024-12-21T07:54:53.808ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
27662024-12-21T07:54:53.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51112 req_id = 6257efb1-5236-4466-8a92-375c0cc79db3 response_code = 204 uri = /eip-gateways
27672024-12-21T07:54:53.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36621 req_id = b154d855-379a-4edd-bc50-6a3a77a706af response_code = 204 uri = /vpc-routes
27682024-12-21T07:54:53.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53126
27692024-12-21T07:54:53.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53126 req_id = b2929001-1900-41ce-ba7d-a75a50ba1b09 response_code = 200 uri = /v2p
27702024-12-21T07:54:53.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48550
27712024-12-21T07:54:53.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27722024-12-21T07:54:53.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27732024-12-21T07:54:53.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48550 req_id = 3f601bd8-b8e8-4d8a-828e-7db6dec8149b response_code = 204 uri = /switch-ports
27742024-12-21T07:54:53.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45407
27752024-12-21T07:54:53.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56315
27762024-12-21T07:54:53.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50764
27772024-12-21T07:54:53.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48550 req_id = f138fd76-f9d0-461d-bd1c-ad15e0881868 response_code = 200 uri = /network-bootstore-config
27782024-12-21T07:54:53.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50764 req_id = 20c76d15-158d-4b7e-97b0-b707d5e172eb response_code = 200 uri = /v2p
27792024-12-21T07:54:53.948ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27802024-12-21T07:54:53.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 641 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51112 req_id = 07524f7e-7cfa-4c75-88e6-adba534e8826 response_code = 204 uri = /vpc-routes
27812024-12-21T07:54:53.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5494 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56315 req_id = ae98502d-e569-499e-a34e-4c2e2d68c0d9 response_code = 200 uri = /vpc-routes
27822024-12-21T07:54:53.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64952
27832024-12-21T07:54:53.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27842024-12-21T07:54:53.995ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
27852024-12-21T07:54:53.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56315 req_id = 7d4ff1dd-b7fb-4c67-ac7a-0065de19d2c7 response_code = 204 uri = /eip-gateways
27862024-12-21T07:54:54.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 633 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56315 req_id = c49aa3a1-ee2d-4acc-9385-6ffe160392ab response_code = 204 uri = /vpc-routes
27872024-12-21T07:54:54.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27882024-12-21T07:54:54.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95882 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45407 req_id = ee49dca1-7728-46d7-bf34-9119ad7f587b response_code = 204 uri = /switch-ports
27892024-12-21T07:54:54.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 694 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45407 req_id = b61ab926-0187-4231-976f-f272aa52c4d3 response_code = 200 uri = /network-bootstore-config
27902024-12-21T07:54:54.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27912024-12-21T07:54:54.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53017
27922024-12-21T07:54:54.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53017 req_id = d90da1bd-1571-480c-8e7b-67aea6e9a686 response_code = 200 uri = /v2p
27932024-12-21T07:54:54.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167129 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64952 req_id = 0625b0e3-a5e6-4675-9bdc-90d27bb4c869 response_code = 204 uri = /switch-ports
27942024-12-21T07:54:54.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64952 req_id = 8ad77a29-e0b2-4dae-ab12-5d69c22611e1 response_code = 200 uri = /network-bootstore-config
27952024-12-21T07:55:05.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7854 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 03eae771-3bff-4243-ba87-e9868c2731a9 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
27962024-12-21T07:55:17.114ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38274
27972024-12-21T07:55:17.114ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38274 req_id = afc72ca5-ccb4-4c55-84ef-63905ed055c4 response_code = 200 uri = /baseboard
27982024-12-21T07:55:23.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60744
27992024-12-21T07:55:23.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60744 req_id = 6b7aea53-6565-4eb6-bc17-6e8226eeb5e8 response_code = 200 uri = /vpc-routes
28002024-12-21T07:55:23.865ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28012024-12-21T07:55:23.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60744 req_id = 2048d44e-64e7-4bb9-b59e-57e91ea8564f response_code = 204 uri = /eip-gateways
28022024-12-21T07:55:23.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50111
28032024-12-21T07:55:23.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50111 req_id = ca816172-c3f8-45b3-af37-6ce2f3741356 response_code = 200 uri = /vpc-routes
28042024-12-21T07:55:23.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47524
28052024-12-21T07:55:23.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47524 req_id = bf02f801-0e90-46f0-87a7-01171a5121d1 response_code = 200 uri = /vpc-routes
28062024-12-21T07:55:23.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28072024-12-21T07:55:23.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50111 req_id = 11a527b1-fb7c-453b-8bd4-b37347239610 response_code = 204 uri = /eip-gateways
28082024-12-21T07:55:23.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 431 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50111 req_id = 7fd60924-6b11-4828-9f21-758dc2af1616 response_code = 204 uri = /vpc-routes
28092024-12-21T07:55:23.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28102024-12-21T07:55:23.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47524 req_id = eb422b93-bfdb-4940-8eda-00ad9fd121b1 response_code = 204 uri = /eip-gateways
28112024-12-21T07:55:23.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47524 req_id = 0ee33aa2-04cb-4f72-bf99-8248fa5b371b response_code = 204 uri = /vpc-routes
28122024-12-21T07:55:23.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43589
28132024-12-21T07:55:23.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43589 req_id = 1c602f23-4d4a-4f35-ae52-189fa03e0630 response_code = 200 uri = /v2p
28142024-12-21T07:55:23.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60744 req_id = 49acc1b8-ba92-4210-b242-6a975a7610fe response_code = 204 uri = /vpc-routes
28152024-12-21T07:55:24.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56756
28162024-12-21T07:55:24.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28172024-12-21T07:55:24.073ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28182024-12-21T07:55:24.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101460 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56756 req_id = 718a9c45-48fd-4865-823b-987957064d88 response_code = 204 uri = /switch-ports
28192024-12-21T07:55:24.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50971
28202024-12-21T07:55:24.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41218
28212024-12-21T07:55:24.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49168
28222024-12-21T07:55:24.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56756 req_id = 3ffc3a52-425e-4bde-8251-2a283b93d7a9 response_code = 200 uri = /network-bootstore-config
28232024-12-21T07:55:24.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50971 req_id = a5c23d46-6c9f-4b66-9ebd-c1069c602c77 response_code = 200 uri = /v2p
28242024-12-21T07:55:24.134ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28252024-12-21T07:55:24.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41218 req_id = 56bdb36b-3b11-42b6-b4f1-55f7e6912ee4 response_code = 200 uri = /v2p
28262024-12-21T07:55:24.172ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28272024-12-21T07:55:24.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53568
28282024-12-21T07:55:24.228ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28292024-12-21T07:55:24.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49168 req_id = 508ac10d-92df-4360-89fa-20c903326b82 response_code = 204 uri = /switch-ports
28302024-12-21T07:55:24.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 735 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49168 req_id = a2ae9013-f3d7-4a09-9313-61f67d7d93fd response_code = 200 uri = /network-bootstore-config
28312024-12-21T07:55:24.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28322024-12-21T07:55:24.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114065 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53568 req_id = 83bdb53c-53d2-4152-b568-b15e044222d0 response_code = 204 uri = /switch-ports
28332024-12-21T07:55:24.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53568 req_id = ff013c1f-b3d5-4579-aad9-bc7b40fc76cb response_code = 200 uri = /network-bootstore-config
28342024-12-21T07:55:35.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7464 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 01c92440-a1ed-42df-b1c2-77be8e584430 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
28352024-12-21T07:55:47.146ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33608
28362024-12-21T07:55:47.146ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33608 req_id = 8edf4dc9-0eb4-4777-a6fc-9ddde1f78804 response_code = 200 uri = /baseboard
28372024-12-21T07:55:53.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58258
28382024-12-21T07:55:53.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58258 req_id = 632d16b7-69d4-4d8d-adce-5719750b14b4 response_code = 200 uri = /vpc-routes
28392024-12-21T07:55:53.707ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28402024-12-21T07:55:53.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58258 req_id = e43e1e48-d786-42a8-bbbf-9998dc1a5332 response_code = 204 uri = /eip-gateways
28412024-12-21T07:55:53.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49607
28422024-12-21T07:55:53.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49607 req_id = 561cb47c-6acf-4825-8805-3253592804e3 response_code = 200 uri = /vpc-routes
28432024-12-21T07:55:53.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28442024-12-21T07:55:53.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49607 req_id = 4ed4b447-b740-4ec5-bff5-680f02ff30af response_code = 204 uri = /eip-gateways
28452024-12-21T07:55:53.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49607 req_id = 48e4507c-e605-432b-acd2-a8e8811257f4 response_code = 204 uri = /vpc-routes
28462024-12-21T07:55:53.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63721
28472024-12-21T07:55:53.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63721 req_id = 83d9cf60-175a-4a18-a508-da95d0a47fda response_code = 200 uri = /v2p
28482024-12-21T07:55:53.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58258 req_id = 745f9173-585c-4328-85ff-cbb726738454 response_code = 204 uri = /vpc-routes
28492024-12-21T07:55:53.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35679
28502024-12-21T07:55:53.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35679 req_id = 47b39c04-2292-4140-afcc-24949e2edc34 response_code = 200 uri = /vpc-routes
28512024-12-21T07:55:53.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34278
28522024-12-21T07:55:53.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34278 req_id = 071d76e4-d92a-48aa-833e-1dc8b3b90c30 response_code = 200 uri = /v2p
28532024-12-21T07:55:53.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34011
28542024-12-21T07:55:53.853ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28552024-12-21T07:55:53.898ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28562024-12-21T07:55:53.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106267 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34011 req_id = 69bbbb5f-95ec-47cd-abc2-f264a37a6d19 response_code = 204 uri = /switch-ports
28572024-12-21T07:55:53.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40139
28582024-12-21T07:55:53.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49883
28592024-12-21T07:55:53.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48573
28602024-12-21T07:55:53.960ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28612024-12-21T07:55:53.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35679 req_id = 74f9dcbf-85ba-4dd2-8d1c-3375859e1f04 response_code = 204 uri = /eip-gateways
28622024-12-21T07:55:53.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34011 req_id = b27d9815-a3f0-490e-98ac-609bbee76cc8 response_code = 200 uri = /network-bootstore-config
28632024-12-21T07:55:53.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28642024-12-21T07:55:53.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48573 req_id = ee145bb5-7b4e-401d-b500-c30f77a4acd0 response_code = 200 uri = /v2p
28652024-12-21T07:55:53.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35679 req_id = a0692c14-f0ce-461a-91e3-49ff456cad56 response_code = 204 uri = /vpc-routes
28662024-12-21T07:55:54.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28672024-12-21T07:55:54.060ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28682024-12-21T07:55:54.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40139 req_id = b96d6b91-27a1-4001-9475-755e0af7b1c2 response_code = 204 uri = /switch-ports
28692024-12-21T07:55:54.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 788 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40139 req_id = 65c264bf-563e-4853-9732-79347cfaca81 response_code = 200 uri = /network-bootstore-config
28702024-12-21T07:55:54.096ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28712024-12-21T07:55:54.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190625 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49883 req_id = 05eae05f-68dc-496f-bc53-ac153a1be5b6 response_code = 204 uri = /switch-ports
28722024-12-21T07:55:54.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49883 req_id = cb66fadc-9977-4071-8396-853c1002de00 response_code = 200 uri = /network-bootstore-config
28732024-12-21T07:56:05.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7233 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = dee25096-55e5-41f6-83f4-245bb74402c5 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
28742024-12-21T07:56:17.180ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36466
28752024-12-21T07:56:17.180ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36466 req_id = e0fbda0c-13b2-4f6b-bc2e-7efb06355e76 response_code = 200 uri = /baseboard
28762024-12-21T07:56:23.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42116
28772024-12-21T07:56:23.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42116 req_id = 2391ddf3-ab70-4132-8337-539151e078c2 response_code = 200 uri = /vpc-routes
28782024-12-21T07:56:23.856ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28792024-12-21T07:56:23.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42116 req_id = 283754ae-bc0d-4fbc-b09f-9dd06e37ff04 response_code = 204 uri = /eip-gateways
28802024-12-21T07:56:23.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42116 req_id = 02d16978-1ef2-4dbb-a6f9-f261a65ee9ed response_code = 204 uri = /vpc-routes
28812024-12-21T07:56:23.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53187
28822024-12-21T07:56:23.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53187 req_id = e45ece06-c88e-4046-86ce-3395ff9f6dcc response_code = 200 uri = /vpc-routes
28832024-12-21T07:56:23.922ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28842024-12-21T07:56:23.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53187 req_id = ec42b93a-7d38-496b-945b-04700a95df64 response_code = 204 uri = /eip-gateways
28852024-12-21T07:56:23.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62217
28862024-12-21T07:56:23.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62217 req_id = 11c058b6-820e-4a06-9b8f-c422833af730 response_code = 200 uri = /vpc-routes
28872024-12-21T07:56:24.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33756
28882024-12-21T07:56:24.002ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28892024-12-21T07:56:24.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28902024-12-21T07:56:24.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106329 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33756 req_id = 4baaa380-0238-427d-80c1-d4535a55f0b0 response_code = 204 uri = /switch-ports
28912024-12-21T07:56:24.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62974
28922024-12-21T07:56:24.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
28932024-12-21T07:56:24.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61211
28942024-12-21T07:56:24.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62217 req_id = 58ef8fd0-c6e0-41a7-88ea-f3099bc4cf09 response_code = 204 uri = /eip-gateways
28952024-12-21T07:56:24.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33756 req_id = 9e2d7d7c-b457-4e52-8397-86a81a78c898 response_code = 200 uri = /network-bootstore-config
28962024-12-21T07:56:24.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61211 req_id = b6ac682c-f56d-4754-9c31-543678b1e6ec response_code = 200 uri = /v2p
28972024-12-21T07:56:24.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62974 req_id = dd4721af-e5c6-4377-9c5f-01ea89f30f3c response_code = 200 uri = /v2p
28982024-12-21T07:56:24.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53187 req_id = 37d8aa06-548e-4412-ad69-4c5022e0b883 response_code = 204 uri = /vpc-routes
28992024-12-21T07:56:24.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58804
29002024-12-21T07:56:24.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58804 req_id = f713a4ff-59fe-40d5-a9e7-4e87d0461f1a response_code = 200 uri = /v2p
29012024-12-21T07:56:24.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62217 req_id = ca201d51-0b4d-4309-9297-10b35f1aefb4 response_code = 204 uri = /vpc-routes
29022024-12-21T07:56:24.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51341
29032024-12-21T07:56:24.153ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29042024-12-21T07:56:24.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29052024-12-21T07:56:24.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51341 req_id = f8baa873-4d77-41fa-9d23-04aaa439e46f response_code = 204 uri = /switch-ports
29062024-12-21T07:56:24.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57579
29072024-12-21T07:56:24.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51341 req_id = 4ce9a134-014d-4002-99f8-2824290557f9 response_code = 200 uri = /network-bootstore-config
29082024-12-21T07:56:24.248ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29092024-12-21T07:56:24.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29102024-12-21T07:56:24.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57579 req_id = 59df908f-cfbd-4ecb-b13f-b95d662eb7f5 response_code = 204 uri = /switch-ports
29112024-12-21T07:56:24.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57579 req_id = d5ecd490-a9ef-4cd9-8cb5-13657e85b3b5 response_code = 200 uri = /network-bootstore-config
29122024-12-21T07:56:35.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6914 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = fd188a06-5ed8-4385-8c1a-d1d5283d0194 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
29132024-12-21T07:56:47.212ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65092
29142024-12-21T07:56:47.212ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65092 req_id = a307fc30-676d-4a78-b848-decb55304450 response_code = 200 uri = /baseboard
29152024-12-21T07:56:53.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60776
29162024-12-21T07:56:53.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60776 req_id = fc5f9a68-e8a7-4928-a26d-9b0e289830f9 response_code = 200 uri = /vpc-routes
29172024-12-21T07:56:53.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56739
29182024-12-21T07:56:53.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56739 req_id = 581618d4-d349-4e6f-8806-0bb5bcde2f7a response_code = 200 uri = /v2p
29192024-12-21T07:56:53.739ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
29202024-12-21T07:56:53.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60776 req_id = 135d2d69-f86f-4c68-a5cf-a41ebe78bc8b response_code = 204 uri = /eip-gateways
29212024-12-21T07:56:53.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60776 req_id = 471b1be8-130e-46ff-a80a-3ff5aafd5ff7 response_code = 204 uri = /vpc-routes
29222024-12-21T07:56:53.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39262
29232024-12-21T07:56:53.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39262 req_id = b5bb297d-012e-460d-82ee-3d38373954e4 response_code = 200 uri = /vpc-routes
29242024-12-21T07:56:53.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34021
29252024-12-21T07:56:53.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34021 req_id = ff6353a8-1cc7-4930-8dfb-087a59231170 response_code = 200 uri = /vpc-routes
29262024-12-21T07:56:53.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
29272024-12-21T07:56:53.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39262 req_id = a32d6ac3-d63a-4d2a-ac95-7339308d2055 response_code = 204 uri = /eip-gateways
29282024-12-21T07:56:53.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39262 req_id = 4a7c8465-3c68-4b31-aee4-f6543cd1e167 response_code = 204 uri = /vpc-routes
29292024-12-21T07:56:53.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42760
29302024-12-21T07:56:53.833ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29312024-12-21T07:56:53.868ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29322024-12-21T07:56:53.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42760 req_id = 3a08200e-59ae-400d-a8fe-c853a515e563 response_code = 204 uri = /switch-ports
29332024-12-21T07:56:53.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60544
29342024-12-21T07:56:53.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64060
29352024-12-21T07:56:53.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63080
29362024-12-21T07:56:53.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
29372024-12-21T07:56:53.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54038
29382024-12-21T07:56:53.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42760 req_id = d47e8d7a-8c5b-4625-8bc5-a4eb691c6432 response_code = 200 uri = /network-bootstore-config
29392024-12-21T07:56:53.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34021 req_id = 35576b7c-3c6a-4913-9298-68722484eace response_code = 204 uri = /eip-gateways
29402024-12-21T07:56:53.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60544 req_id = d2c59078-6dbb-4f39-bc6c-3c4086b1ed03 response_code = 200 uri = /v2p
29412024-12-21T07:56:53.928ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29422024-12-21T07:56:53.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63080 req_id = cb263f73-3f66-48d5-959b-a03daab6abcb response_code = 200 uri = /v2p
29432024-12-21T07:56:53.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34021 req_id = 0ca10a81-5dab-4372-ade6-888b4b2eaa9a response_code = 204 uri = /vpc-routes
29442024-12-21T07:56:53.966ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29452024-12-21T07:56:54.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29462024-12-21T07:56:54.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92765 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54038 req_id = b48bcbbc-3c05-4929-b180-a8500e77397c response_code = 204 uri = /switch-ports
29472024-12-21T07:56:54.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 865 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54038 req_id = bff77d57-7074-4ea9-bf69-8ee3d44c7d96 response_code = 200 uri = /network-bootstore-config
29482024-12-21T07:56:54.054ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29492024-12-21T07:56:54.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64060 req_id = f69c3868-2d05-4245-b615-dfcce5da2026 response_code = 204 uri = /switch-ports
29502024-12-21T07:56:54.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64060 req_id = 8615e3a4-65b8-444a-8c0a-cff94550cb1f response_code = 200 uri = /network-bootstore-config
29512024-12-21T07:57:05.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7587 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 478e16cb-b6fb-4894-be74-c5a67dc50dea response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
29522024-12-21T07:57:17.246ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39844
29532024-12-21T07:57:17.246ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39844 req_id = 0b8a735b-55e6-4b93-bba0-02e890c7e4ed response_code = 200 uri = /baseboard
29542024-12-21T07:57:23.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50728
29552024-12-21T07:57:23.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50728 req_id = 64f97831-eb5d-444b-87c9-51b127b41c45 response_code = 200 uri = /v2p
29562024-12-21T07:57:23.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38470
29572024-12-21T07:57:23.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38470 req_id = 6a8b210d-e9e4-4a50-8aae-71c194051139 response_code = 200 uri = /vpc-routes
29582024-12-21T07:57:24.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
29592024-12-21T07:57:24.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38470 req_id = 9e2860ed-a4b8-4316-b824-7b32e9ca3224 response_code = 204 uri = /eip-gateways
29602024-12-21T07:57:24.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34376
29612024-12-21T07:57:24.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34376 req_id = 11670170-d30f-4811-bb6f-422805e07778 response_code = 200 uri = /vpc-routes
29622024-12-21T07:57:24.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60492
29632024-12-21T07:57:24.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60492 req_id = 902a3ad9-c6e1-4c0b-a40c-42fbf1916a2e response_code = 200 uri = /v2p
29642024-12-21T07:57:24.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38470 req_id = 9c25d1ba-8bb6-4408-ab21-b324dd0bb960 response_code = 204 uri = /vpc-routes
29652024-12-21T07:57:24.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63730
29662024-12-21T07:57:24.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29672024-12-21T07:57:24.171ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29682024-12-21T07:57:24.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63730 req_id = 2a592374-08a1-4faa-8d17-b38e86c53bd7 response_code = 204 uri = /switch-ports
29692024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44268
29702024-12-21T07:57:24.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
29712024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34376 req_id = 6c2149af-987b-468f-be11-573e6e0379dd response_code = 204 uri = /eip-gateways
29722024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51294
29732024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46005
29742024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63730 req_id = 9bf81dfd-04eb-4a4a-8155-2afdbad3c1bb response_code = 200 uri = /network-bootstore-config
29752024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33374
29762024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44268 req_id = 11d982b5-c312-49da-8ce2-7f5c7dd995fa response_code = 200 uri = /vpc-routes
29772024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47307
29782024-12-21T07:57:24.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46005 req_id = 8f1e450d-dab3-4de6-8e7b-008ba393950a response_code = 200 uri = /v2p
29792024-12-21T07:57:24.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29802024-12-21T07:57:24.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29812024-12-21T07:57:24.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29822024-12-21T07:57:24.246ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29832024-12-21T07:57:24.246ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
29842024-12-21T07:57:24.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63622
29852024-12-21T07:57:24.253ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
29862024-12-21T07:57:24.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34376 req_id = 2842ae33-dd71-4b50-9cd6-9f4582aa2575 response_code = 204 uri = /vpc-routes
29872024-12-21T07:57:24.267ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29882024-12-21T07:57:24.267ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff
29892024-12-21T07:57:24.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48872
29902024-12-21T07:57:24.274ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29912024-12-21T07:57:24.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
29922024-12-21T07:57:24.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29932024-12-21T07:57:24.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29942024-12-21T07:57:24.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29952024-12-21T07:57:24.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29962024-12-21T07:57:24.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29972024-12-21T07:57:24.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1465 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48872 req_id = dc9f1ea7-ee4b-4d77-91f5-dd521e217eae response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29982024-12-21T07:57:24.284ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29992024-12-21T07:57:24.285ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
30002024-12-21T07:57:24.290ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
30012024-12-21T07:57:24.291ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
30022024-12-21T07:57:24.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44268 req_id = 81b919db-70c4-4732-8d95-6cb3c67e58fe response_code = 204 uri = /eip-gateways
30032024-12-21T07:57:24.291ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30042024-12-21T07:57:24.299ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30052024-12-21T07:57:24.299ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac
30062024-12-21T07:57:24.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 994 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44268 req_id = 6e83df5a-4b75-4a42-b022-4115190818f5 response_code = 204 uri = /vpc-routes
30072024-12-21T07:57:24.317ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30082024-12-21T07:57:24.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff
30092024-12-21T07:57:24.351ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30102024-12-21T07:57:24.351ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac
30112024-12-21T07:57:24.362ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30122024-12-21T07:57:24.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51294 req_id = 8ea3aeca-55d3-4a91-9c96-29b9b3c3766a response_code = 204 uri = /switch-ports
30132024-12-21T07:57:24.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 932 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51294 req_id = dd4cb398-8ecd-4863-9d5a-ca80ce0e0807 response_code = 200 uri = /network-bootstore-config
30142024-12-21T07:57:24.368ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30152024-12-21T07:57:24.368ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240
30162024-12-21T07:57:24.388ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30172024-12-21T07:57:24.388ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240
30182024-12-21T07:57:24.403ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30192024-12-21T07:57:24.403ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd7c5ec-686c-4ecd-8837-505154304410
30202024-12-21T07:57:24.406ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30212024-12-21T07:57:24.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34881
30222024-12-21T07:57:24.415ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
30232024-12-21T07:57:24.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
30242024-12-21T07:57:24.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30252024-12-21T07:57:24.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30262024-12-21T07:57:24.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30272024-12-21T07:57:24.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30282024-12-21T07:57:24.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30292024-12-21T07:57:24.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34881 req_id = 208efaca-bede-4346-afff-53a69ba2bb55 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
30302024-12-21T07:57:24.428ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30312024-12-21T07:57:24.428ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7
30322024-12-21T07:57:24.442ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30332024-12-21T07:57:24.442ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd7c5ec-686c-4ecd-8837-505154304410
30342024-12-21T07:57:24.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51789
30352024-12-21T07:57:24.456ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
30362024-12-21T07:57:24.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
30372024-12-21T07:57:24.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30382024-12-21T07:57:24.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30392024-12-21T07:57:24.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30402024-12-21T07:57:24.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30412024-12-21T07:57:24.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30422024-12-21T07:57:24.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51789 req_id = 3639b551-5265-4e5a-a2b7-80f263014914 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
30432024-12-21T07:57:24.463ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30442024-12-21T07:57:24.463ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e
30452024-12-21T07:57:24.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63622 req_id = dd4705cb-986f-4ba2-9d39-a9646a556ab4 response_code = 204 uri = /switch-ports
30462024-12-21T07:57:24.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63622 req_id = eca3088a-a910-425b-a654-2a4165f2a978 response_code = 200 uri = /network-bootstore-config
30472024-12-21T07:57:24.479ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30482024-12-21T07:57:24.479ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7
30492024-12-21T07:57:24.492ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30502024-12-21T07:57:24.492ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d75297c3-49da-487f-a95f-88dc2681ce54
30512024-12-21T07:57:24.514ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30522024-12-21T07:57:24.514ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798
30532024-12-21T07:57:24.525ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30542024-12-21T07:57:24.525ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e
30552024-12-21T07:57:24.540ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30562024-12-21T07:57:24.540ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64
30572024-12-21T07:57:24.554ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30582024-12-21T07:57:24.554ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d75297c3-49da-487f-a95f-88dc2681ce54
30592024-12-21T07:57:24.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47307 req_id = 698337a3-1c69-4169-a8d4-ad1a1ffb53b7 response_code = 200 uri = /inventory
30602024-12-21T07:57:24.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30612024-12-21T07:57:24.574ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798
30622024-12-21T07:57:24.598ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30632024-12-21T07:57:24.598ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64
30642024-12-21T07:57:24.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366780 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33374 req_id = 1eb3f0bb-4436-4a46-b4ed-5491c3f89491 response_code = 200 uri = /inventory
30652024-12-21T07:57:25.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61262
30662024-12-21T07:57:25.299ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30672024-12-21T07:57:25.299ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30682024-12-21T07:57:25.299ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/config/omicron-zones.json file = common/src/ledger.rs:177
30692024-12-21T07:57:25.299ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/config/omicron-zones.json file = common/src/ledger.rs:177
30702024-12-21T07:57:25.312ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30712024-12-21T07:57:25.313ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a75efd9d-b0a6-49fa-9887-7bf9c3c748ff
30722024-12-21T07:57:25.339ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e8ede2cc-0135-41ed-915f-5a407cd024ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30732024-12-21T07:57:25.339ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e8ede2cc-0135-41ed-915f-5a407cd024ac
30742024-12-21T07:57:25.360ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30752024-12-21T07:57:25.360ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_47117fb2-2ba2-45f6-9fbf-38d2fc290240
30762024-12-21T07:57:25.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd7c5ec-686c-4ecd-8837-505154304410 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30772024-12-21T07:57:25.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd7c5ec-686c-4ecd-8837-505154304410
30782024-12-21T07:57:25.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a5fffa1-3567-4a76-80de-99fa969ecbb7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30792024-12-21T07:57:25.404ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a5fffa1-3567-4a76-80de-99fa969ecbb7
30802024-12-21T07:57:25.426ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30812024-12-21T07:57:25.426ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e
30822024-12-21T07:57:25.447ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d75297c3-49da-487f-a95f-88dc2681ce54 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30832024-12-21T07:57:25.447ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d75297c3-49da-487f-a95f-88dc2681ce54
30842024-12-21T07:57:25.468ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 250ef3db-29d3-4600-be58-ffbaa8dc3798 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30852024-12-21T07:57:25.468ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_250ef3db-29d3-4600-be58-ffbaa8dc3798
30862024-12-21T07:57:25.490ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3842ea59-807a-474c-8f0e-ecda23fe9c64 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30872024-12-21T07:57:25.490ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3842ea59-807a-474c-8f0e-ecda23fe9c64
30882024-12-21T07:57:25.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203567 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61262 req_id = 4ca8326d-42c8-4acc-b96a-2212ee692c07 response_code = 200 uri = /inventory
30892024-12-21T07:57:35.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7346 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = 2017a97e-77c2-4e66-beaa-fbdc2137e52c response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
30902024-12-21T07:57:47.278ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47092
30912024-12-21T07:57:47.279ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47092 req_id = 1e203045-6554-43a8-94d8-d33ea44353c9 response_code = 200 uri = /baseboard
30922024-12-21T07:57:53.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55831
30932024-12-21T07:57:53.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55831 req_id = b70975be-41f3-4c9f-a524-6e7da2ccca94 response_code = 200 uri = /vpc-routes
30942024-12-21T07:57:53.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42693
30952024-12-21T07:57:53.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42693 req_id = 7242385a-cf33-48a8-8b18-be030be7aa7f response_code = 200 uri = /vpc-routes
30962024-12-21T07:57:53.755ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
30972024-12-21T07:57:53.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55831 req_id = 9b1ac27c-5e92-4158-a2d6-33d875566730 response_code = 204 uri = /eip-gateways
30982024-12-21T07:57:53.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55831 req_id = 4ed3b2bb-323b-4d22-bee0-c0dcc5fa93d2 response_code = 204 uri = /vpc-routes
30992024-12-21T07:57:53.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45165
31002024-12-21T07:57:53.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45165 req_id = 8e5d1c13-4ba0-4c88-80bb-2e9dade44681 response_code = 200 uri = /vpc-routes
31012024-12-21T07:57:53.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49861
31022024-12-21T07:57:53.798ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31032024-12-21T07:57:53.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31042024-12-21T07:57:53.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100651 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49861 req_id = a2ce3ab9-1c3a-4996-b91e-fb3d9c992ade response_code = 204 uri = /switch-ports
31052024-12-21T07:57:53.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60348
31062024-12-21T07:57:53.899ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
31072024-12-21T07:57:53.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42693 req_id = 5b0b258f-50fc-4358-b6e9-17e1a600f5d6 response_code = 204 uri = /eip-gateways
31082024-12-21T07:57:53.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33087
31092024-12-21T07:57:53.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60495
31102024-12-21T07:57:53.899ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
31112024-12-21T07:57:53.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45165 req_id = a0cdcbea-6e1f-483a-8de4-6f9d886a0cb6 response_code = 204 uri = /eip-gateways
31122024-12-21T07:57:53.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49861 req_id = 0fad54c4-452e-45a5-bd22-6a7ca3fcf447 response_code = 200 uri = /network-bootstore-config
31132024-12-21T07:57:53.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60348 req_id = 2dbbc628-3936-4df9-9913-925b2419fd67 response_code = 200 uri = /v2p
31142024-12-21T07:57:53.899ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31152024-12-21T07:57:53.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33087 req_id = 6c403c0e-9466-4d9d-83f3-495272452acc response_code = 200 uri = /v2p
31162024-12-21T07:57:53.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45165 req_id = 599813d7-1ffa-4c19-bd55-01772d5a35fd response_code = 204 uri = /vpc-routes
31172024-12-21T07:57:53.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42693 req_id = 7339bd82-06aa-4ea4-b169-a85907b4e2e1 response_code = 204 uri = /vpc-routes
31182024-12-21T07:57:53.940ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31192024-12-21T07:57:53.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48456
31202024-12-21T07:57:53.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48216
31212024-12-21T07:57:53.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48216 req_id = 0ffcffd6-9f87-47f7-a460-bf4f34beea00 response_code = 200 uri = /v2p
31222024-12-21T07:57:53.999ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31232024-12-21T07:57:53.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60495 req_id = 22019743-dd7a-4634-a989-a7d193db3bf8 response_code = 204 uri = /switch-ports
31242024-12-21T07:57:54.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 801 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60495 req_id = b4292e1e-7a90-41e6-8c18-ec6422daa373 response_code = 200 uri = /network-bootstore-config
31252024-12-21T07:57:54.037ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31262024-12-21T07:57:54.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135489 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48456 req_id = c9104909-8642-455b-b8b5-b1d1607962cf response_code = 204 uri = /switch-ports
31272024-12-21T07:57:54.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48456 req_id = 07029017-bea9-4295-9a2f-79d816461cca response_code = 200 uri = /network-bootstore-config
31282024-12-21T07:58:05.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6861 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = d35f48df-e82c-4e0d-b843-ab830043ab75 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
31292024-12-21T07:58:17.311ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42547
31302024-12-21T07:58:17.312ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42547 req_id = bbc118ad-e4b3-4144-9d1c-93d448c57692 response_code = 200 uri = /baseboard
31312024-12-21T07:58:23.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51789
31322024-12-21T07:58:23.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51789 req_id = 4b5a0b38-7e53-49d6-afda-812ef56ea73a response_code = 200 uri = /vpc-routes
31332024-12-21T07:58:23.815ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
31342024-12-21T07:58:23.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51789 req_id = 5f1dcc9c-e6c8-41da-829d-5144e04145e1 response_code = 204 uri = /eip-gateways
31352024-12-21T07:58:23.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51789 req_id = 6fcfb53a-ea5a-4d7c-9800-ac1e43dd7e2f response_code = 204 uri = /vpc-routes
31362024-12-21T07:58:23.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36540
31372024-12-21T07:58:23.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36540 req_id = 1491f885-8d72-42bf-960d-45e5c819ee63 response_code = 200 uri = /vpc-routes
31382024-12-21T07:58:23.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64441
31392024-12-21T07:58:23.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31402024-12-21T07:58:24.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31412024-12-21T07:58:24.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64441 req_id = 2cd968e3-728c-41c6-a9b5-2bd821d5df2c response_code = 204 uri = /switch-ports
31422024-12-21T07:58:24.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33503
31432024-12-21T07:58:24.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53797
31442024-12-21T07:58:24.071ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
31452024-12-21T07:58:24.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33503 req_id = 4c4fe016-0ac6-41d3-880c-2bcdc8703ed8 response_code = 200 uri = /vpc-routes
31462024-12-21T07:58:24.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36540 req_id = 0227ac0d-3ced-44e1-9609-ef7ab7c99506 response_code = 204 uri = /eip-gateways
31472024-12-21T07:58:24.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64441 req_id = 0c1becc8-7baa-4e30-831e-277ce2b05b76 response_code = 200 uri = /network-bootstore-config
31482024-12-21T07:58:24.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53797 req_id = ffae86ba-37d8-41d8-9b94-f3e34ab58340 response_code = 200 uri = /v2p
31492024-12-21T07:58:24.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36540 req_id = a15ba03a-3501-4f9f-a441-0986506bd306 response_code = 204 uri = /vpc-routes
31502024-12-21T07:58:24.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65482
31512024-12-21T07:58:24.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65482 req_id = 53f8f4a6-694b-4d2f-ab6c-b221f66c288f response_code = 200 uri = /v2p
31522024-12-21T07:58:24.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36948
31532024-12-21T07:58:24.111ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31542024-12-21T07:58:24.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31552024-12-21T07:58:24.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91326 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36948 req_id = 618e6621-eaa3-4ef7-92b0-2498b92fd740 response_code = 204 uri = /switch-ports
31562024-12-21T07:58:24.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58413
31572024-12-21T07:58:24.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
31582024-12-21T07:58:24.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33503 req_id = a1412def-2e42-48be-bcc3-7f3dc9ad29b2 response_code = 204 uri = /eip-gateways
31592024-12-21T07:58:24.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36948 req_id = 687124b1-e017-47c6-b65e-557ed6eb3baf response_code = 200 uri = /network-bootstore-config
31602024-12-21T07:58:24.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58413 req_id = e47925cb-937a-473d-8d4e-55eef6b1a1a1 response_code = 200 uri = /v2p
31612024-12-21T07:58:24.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33503 req_id = beff84e3-1e04-43e3-9af5-67a2e9f9e027 response_code = 204 uri = /vpc-routes
31622024-12-21T07:58:24.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48542
31632024-12-21T07:58:24.264ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31642024-12-21T07:58:24.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31652024-12-21T07:58:24.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48542 req_id = f8531297-404d-4029-a0e8-7735b0e57338 response_code = 204 uri = /switch-ports
31662024-12-21T07:58:24.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48542 req_id = 15e184da-6164-40a5-9f9e-4dc7c7ef6c13 response_code = 200 uri = /network-bootstore-config
31672024-12-21T07:58:35.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7282 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = e684e2de-be92-4316-8636-ad4ffd2d3796 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
31682024-12-21T07:58:45.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58735
31692024-12-21T07:58:45.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58735 req_id = 3475536d-7295-4590-88f1-a95cebbfdb95 response_code = 200 uri = /v2p
31702024-12-21T07:58:45.523ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(7358898) }
31712024-12-21T07:58:45.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58735 req_id = 37816fc7-8c8f-4fc8-91be-103f1ac20036 response_code = 204 uri = /v2p
31722024-12-21T07:58:45.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35933
31732024-12-21T07:58:45.637ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 169256bd-a993-4243-8a33-d9a8a0e7f510, kind: Instance { id: 6f7deba6-bca8-40a5-a059-99eca3610b4b }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7358898), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 169256bd-a993-4243-8a33-d9a8a0e7f510, kind: Instance { id: 6f7deba6-bca8-40a5-a059-99eca3610b4b }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7358898), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 169256bd-a993-4243-8a33-d9a8a0e7f510, kind: Instance { id: 6f7deba6-bca8-40a5-a059-99eca3610b4b }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7358898), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(7358898))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 169256bd-a993-4243-8a33-d9a8a0e7f510, kind: Instance { id: 6f7deba6-bca8-40a5-a059-99eca3610b4b }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7358898), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: cc0d85d2-67d8-4ae7-804f-84b23328c7c8, slot: 0, read_only: false, vcr_json: .., name: "disk-5c2bd2fd768" }], boot_settings: Some(InstanceBootSettings { order: [cc0d85d2-67d8-4ae7-804f-84b23328c7c8] }), cloud_init_bytes: Some(..) } instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b metadata = InstanceMetadata { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, project_id: 27cf67c6-23b4-42ef-b405-5566b18d9353 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T07:58:45.632327350Z }
31742024-12-21T07:58:45.637ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b migration_id = None propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
31752024-12-21T07:58:45.638ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b migration_id = None propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 169256bd-a993-4243-8a33-d9a8a0e7f510, kind: Instance { id: 6f7deba6-bca8-40a5-a059-99eca3610b4b }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7358898), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 169256bd-a993-4243-8a33-d9a8a0e7f510, kind: Instance { id: 6f7deba6-bca8-40a5-a059-99eca3610b4b }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7358898), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 169256bd-a993-4243-8a33-d9a8a0e7f510, kind: Instance { id: 6f7deba6-bca8-40a5-a059-99eca3610b4b }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7358898), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(7358898))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 169256bd-a993-4243-8a33-d9a8a0e7f510, kind: Instance { id: 6f7deba6-bca8-40a5-a059-99eca3610b4b }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7358898), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: cc0d85d2-67d8-4ae7-804f-84b23328c7c8, slot: 0, read_only: false, vcr_json: .., name: "disk-5c2bd2fd768" }], boot_settings: Some(InstanceBootSettings { order: [cc0d85d2-67d8-4ae7-804f-84b23328c7c8] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T07:58:45.632327350Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
31762024-12-21T07:58:45.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7846 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35933 req_id = b942cf0b-3e98-4be6-bf31-21d5e1e5f074 response_code = 200 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
31772024-12-21T07:58:45.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45957
31782024-12-21T07:58:45.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45957 req_id = 6cdcfce8-4b75-426f-ab44-9ffdec1de707 response_code = 200 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state
31792024-12-21T07:58:45.749ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 7358898 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
31802024-12-21T07:58:45.749ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31812024-12-21T07:58:45.790ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f file = illumos-utils/src/zone.rs:325 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
31822024-12-21T07:58:45.814ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f file = illumos-utils/src/zone.rs:363 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
31832024-12-21T07:58:45.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51204
31842024-12-21T07:58:45.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51204 req_id = 72cc1ffa-d562-4161-aec4-018659593c18 response_code = 200 uri = /vpc-routes
31852024-12-21T07:58:45.873ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {169256bd-a993-4243-8a33-d9a8a0e7f510: {10.151.1.175: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}, 10.151.1.176: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}}} }
31862024-12-21T07:58:47.107ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
31872024-12-21T07:58:47.107ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f zone file = illumos-utils/src/running_zone.rs:488 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31882024-12-21T07:58:47.325ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 32.568013ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31892024-12-21T07:58:47.345ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48477
31902024-12-21T07:58:47.345ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48477 req_id = d6476ea0-c258-4d42-83d0-562c00d095cd response_code = 200 uri = /baseboard
31912024-12-21T07:58:47.368ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 120.460459ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31922024-12-21T07:58:47.505ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 223.581753ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31932024-12-21T07:58:47.741ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 309.202336ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31942024-12-21T07:58:48.066ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 692.749135ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31952024-12-21T07:58:48.773ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 1.373842912s file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31962024-12-21T07:58:50.157ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 733.786607ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31972024-12-21T07:58:50.903ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 583.18172ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31982024-12-21T07:58:51.498ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 1.086294866s file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f zone = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
31992024-12-21T07:58:52.613ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f file = sled-agent/src/instance.rs:2067 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32002024-12-21T07:58:52.622ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 31.464349ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32012024-12-21T07:58:52.663ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f") failed: Property not found. retry in 70.874772ms file = illumos-utils/src/svc.rs:36 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32022024-12-21T07:58:52.744ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32032024-12-21T07:58:52.781ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32042024-12-21T07:58:52.921ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32052024-12-21T07:58:52.922ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T07:58:52.922158013Z } file = sled-agent/src/instance.rs:780 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32062024-12-21T07:58:52.922ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T07:58:52.922158013Z } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32072024-12-21T07:58:52.922ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T07:58:52.922158013Z }, migration_in: None, migration_out: None }
32082024-12-21T07:58:52.980ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
32092024-12-21T07:58:52.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7107549 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51204 req_id = b30cdc8f-26c6-42ab-9019-e84b3dc8e3b4 response_code = 204 uri = /eip-gateways
32102024-12-21T07:58:52.980ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T07:58:52.980427333Z } file = sled-agent/src/instance.rs:780 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32112024-12-21T07:58:52.980ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:58:52.980427333Z } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32122024-12-21T07:58:52.980ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:58:52.980427333Z }, migration_in: None, migration_out: None }
32132024-12-21T07:58:53.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51204 req_id = 18235e68-9333-4cbe-ab5e-b4d80aab1d9c response_code = 204 uri = /vpc-routes
32142024-12-21T07:58:53.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53263
32152024-12-21T07:58:53.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 738 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53263 req_id = 9458897f-20ef-4401-9cd3-2eb0a8c87d20 response_code = 200 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state
32162024-12-21T07:58:53.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42314
32172024-12-21T07:58:53.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42314 req_id = 8956475b-0bfd-42ce-944f-5a6b0ddcf2d2 response_code = 200 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state
32182024-12-21T07:58:53.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52332
32192024-12-21T07:58:53.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52332 req_id = b371541b-5abd-43c9-9d0a-36ac608d25fb response_code = 200 uri = /vpc-routes
32202024-12-21T07:58:53.776ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {169256bd-a993-4243-8a33-d9a8a0e7f510: {10.151.1.176: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}, 10.151.1.175: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}}} }
32212024-12-21T07:58:53.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52332 req_id = e2a41c47-444b-4fc9-b2db-f25fefa82fa4 response_code = 204 uri = /eip-gateways
32222024-12-21T07:58:53.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61483
32232024-12-21T07:58:53.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61483 req_id = dd9fd614-a092-44d2-a2c7-7d11e943ae34 response_code = 200 uri = /vpc-routes
32242024-12-21T07:58:53.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56096
32252024-12-21T07:58:53.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56096 req_id = 90c47c14-89d7-4698-8c01-d4dac5512bec response_code = 200 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state
32262024-12-21T07:58:53.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {169256bd-a993-4243-8a33-d9a8a0e7f510: {10.151.1.175: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}, 10.151.1.176: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}}} }
32272024-12-21T07:58:53.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61483 req_id = 22fb0912-4da3-4c99-add6-1f07aee46642 response_code = 204 uri = /eip-gateways
32282024-12-21T07:58:53.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39623
32292024-12-21T07:58:53.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39623 req_id = 5277c230-c219-4248-ba70-9bc9bc1d2f16 response_code = 200 uri = /v2p
32302024-12-21T07:58:53.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52332 req_id = dc1fdccb-772b-4a83-9b07-c3e46b57c9a6 response_code = 204 uri = /vpc-routes
32312024-12-21T07:58:53.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45565
32322024-12-21T07:58:53.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45565 req_id = bfb19755-c87d-4108-8a91-83dc7fa1a986 response_code = 200 uri = /vpc-routes
32332024-12-21T07:58:53.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52406
32342024-12-21T07:58:53.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52406 req_id = f4e3d310-d51b-46c7-9e7a-03fcfaccd231 response_code = 200 uri = /v2p
32352024-12-21T07:58:53.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61483 req_id = a960b5e2-7712-4ca0-95ae-18c0eac326d1 response_code = 204 uri = /vpc-routes
32362024-12-21T07:58:53.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63394
32372024-12-21T07:58:53.889ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
32382024-12-21T07:58:53.933ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
32392024-12-21T07:58:53.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104656 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63394 req_id = 7e38caf1-2ce2-411d-974a-67ed24f1c444 response_code = 204 uri = /switch-ports
32402024-12-21T07:58:53.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64606
32412024-12-21T07:58:53.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {169256bd-a993-4243-8a33-d9a8a0e7f510: {10.151.1.176: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}, 10.151.1.175: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}}} }
32422024-12-21T07:58:53.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49404
32432024-12-21T07:58:53.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45565 req_id = e88eab4e-6700-4041-8241-3798d322706f response_code = 204 uri = /eip-gateways
32442024-12-21T07:58:53.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51831
32452024-12-21T07:58:53.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63394 req_id = ee10e8b5-a4e5-4774-940e-265f1fdeb733 response_code = 200 uri = /network-bootstore-config
32462024-12-21T07:58:53.995ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
32472024-12-21T07:58:53.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49404 req_id = 93d5d47c-134b-4ba7-b5b7-7d291653f028 response_code = 200 uri = /v2p
32482024-12-21T07:58:54.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45565 req_id = 1afed0ad-c7af-4ce4-95e5-41325a5c21ce response_code = 204 uri = /vpc-routes
32492024-12-21T07:58:54.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
32502024-12-21T07:58:54.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
32512024-12-21T07:58:54.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98929 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64606 req_id = b6271e02-e2fa-4e7b-b7e8-4f55a72bfb13 response_code = 204 uri = /switch-ports
32522024-12-21T07:58:54.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64606 req_id = ad4673ee-fed7-4fed-9991-037324299475 response_code = 200 uri = /network-bootstore-config
32532024-12-21T07:58:54.133ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
32542024-12-21T07:58:54.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51831 req_id = 9117aaea-4710-410a-a4ce-b0aa0a63e945 response_code = 204 uri = /switch-ports
32552024-12-21T07:58:54.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51831 req_id = bbf324f6-1a61-42e9-81e0-9403c802cd62 response_code = 200 uri = /network-bootstore-config
32562024-12-21T07:59:03.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42023
32572024-12-21T07:59:03.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 466 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42023 req_id = 155b96bd-06e5-4d6f-bbd8-50bbe149c85f response_code = 200 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state
32582024-12-21T07:59:03.332ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T07:59:03.332894386Z } file = sled-agent/src/instance.rs:780 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32592024-12-21T07:59:03.332ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T07:59:03.332894386Z } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32602024-12-21T07:59:03.332ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T07:59:03.332894386Z }, migration_in: None, migration_out: None }
32612024-12-21T07:59:03.386ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T07:59:03.386390694Z } file = sled-agent/src/instance.rs:780 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32622024-12-21T07:59:03.386ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-21T07:59:03.386390694Z } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32632024-12-21T07:59:03.386ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32642024-12-21T07:59:03.386ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
32652024-12-21T07:59:03.386ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7319588372246576377 n_samples = 6 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
32662024-12-21T07:59:03.386ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 12591672703461467294 n_samples = 6 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
32672024-12-21T07:59:03.386ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
32682024-12-21T07:59:03.386ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/0beb8380-bb01-4a3d-b2e4-91e2c1bc69ae/debug/bundle/zone", "/pool/int/52553f89-077b-4090-bd7d-0f6aaa2f3eae/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/a75efd9d-b0a6-49fa-9887-7bf9c3c748ff/crypt/debug", "/pool/ext/e8ede2cc-0135-41ed-915f-5a407cd024ac/crypt/debug", "/pool/ext/47117fb2-2ba2-45f6-9fbf-38d2fc290240/crypt/debug", "/pool/ext/9cd7c5ec-686c-4ecd-8837-505154304410/crypt/debug", "/pool/ext/8a5fffa1-3567-4a76-80de-99fa969ecbb7/crypt/debug", "/pool/ext/f6ea0bc5-fd9e-4d1c-9d98-a40ec76f1e9e/crypt/debug", "/pool/ext/d75297c3-49da-487f-a95f-88dc2681ce54/crypt/debug", "/pool/ext/250ef3db-29d3-4600-be58-ffbaa8dc3798/crypt/debug", "/pool/ext/3842ea59-807a-474c-8f0e-ecda23fe9c64/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f
32692024-12-21T07:59:04.029ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f", bundle_id: 774d797d-2e23-4f36-a3b5-84f2a07e9823 }, time_created: 2024-12-21T07:59:03.387357730Z, version: 0, cause: TerminatedInstance }
32702024-12-21T07:59:04.029ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_035b4828-aaf9-4ffa-b53c-96c2c815880f file = sled-agent/src/instance.rs:1313 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32712024-12-21T07:59:05.804ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32722024-12-21T07:59:05.822ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(7358898), kind: System }
32732024-12-21T07:59:05.822ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(7358898), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
32742024-12-21T07:59:05.822ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:59:05.822725091Z }, migration_in: None, migration_out: None }
32752024-12-21T07:59:05.856ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:59:05.822725091Z }, migration_in: None, migration_out: None }
32762024-12-21T07:59:05.860ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
32772024-12-21T07:59:05.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6424 local_addr = [fd00:1122:3344:101::1]:55605 method = GET remote_addr = [fd00:1122:3344:101::d]:37210 req_id = b21153aa-40f0-4ea5-965b-493f51205dd1 response_code = 200 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e uri = /c992e3dc-2d80-4655-85d0-78e9a80bf69e
32782024-12-21T07:59:06.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34892
32792024-12-21T07:59:06.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34892 req_id = d135ab1e-54fb-4a53-a39b-8c88606880b9 response_code = 200 uri = /vpc-routes
32802024-12-21T07:59:06.501ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
32812024-12-21T07:59:06.501ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
32822024-12-21T07:59:06.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34892 req_id = c9e13ac3-bc9b-488e-b49b-3d77cb1ceef2 response_code = 204 uri = /eip-gateways
32832024-12-21T07:59:06.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36989
32842024-12-21T07:59:06.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36989 req_id = 6ad69bec-b95c-4d75-87bf-9e4a1f9b82c6 response_code = 200 uri = /v2p
32852024-12-21T07:59:06.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34892 req_id = 61dc24a3-a6ec-45f9-93ac-ce9ca63bb27a response_code = 204 uri = /vpc-routes
32862024-12-21T07:59:07.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57801
32872024-12-21T07:59:07.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57801 req_id = 95d27655-c28c-45d3-a48b-ee51cfcd4463 response_code = 200 uri = /v2p
32882024-12-21T07:59:07.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57021
32892024-12-21T07:59:07.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57021 req_id = 433b6e95-c6ad-49b9-81f1-4a681c50a4d4 response_code = 200 uri = /vpc-routes
32902024-12-21T07:59:07.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
32912024-12-21T07:59:07.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57021 req_id = 636e968c-b51d-4a29-9b4c-7f0a251b6867 response_code = 204 uri = /eip-gateways
32922024-12-21T07:59:07.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57021 req_id = 1e39e353-c140-4d66-acfa-d6974e4a2ddc response_code = 204 uri = /vpc-routes
32932024-12-21T07:59:08.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43913
32942024-12-21T07:59:08.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43913 req_id = 9eacff36-7f5f-4edf-9806-36c063bdf7a5 response_code = 200 uri = /vpc-routes
32952024-12-21T07:59:08.598ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e values = ExternalIpGatewayMap { mappings: {} }
32962024-12-21T07:59:08.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43913 req_id = 6eaee07d-7d18-4426-8c95-836de53ca3ad response_code = 204 uri = /eip-gateways
32972024-12-21T07:59:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43913 req_id = 89a9a334-eeca-4bb3-8641-47814e184941 response_code = 204 uri = /vpc-routes